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m ■ 

. This paper studies the quasi-maximum-likelihood estimator 

(QMLE) in a general conditionally heteroscedastic time series model 
of multiplicative form Xt = atZt, where the unobservable volatility at 
■ is a parametric function of (Xt^i, ■ ■ ■ ,Xt^p,at^i, . . . ,at-q) for some 

^0 ' Pj<? > 0, and (Zt) is standardized i.i.d. noise. We assume that these 

models are solutions to stochastic recurrence equations which satisfy 
a contraction (random Lipschitz coefRcient) property. These assump- 
tions are satisfied for the popular GARCH, asymmetric GARCH and 
exponential GARCH processes. Exploiting the contraction property, 
we give conditions for the existence and uniqueness of a strictly sta- 
tionary solution {Xt) to the stochastic recurrence equation and es- 
tablish consistency and asymptotic normality of the QMLE. We also 
discuss the problem of invertibility of such time series models. 



■3 



> 

(N 

a^ 

I 1. Introduction. Gaussian quasi-maximum-likelihood estimation, that is, 

likelihood estimation under the hypothesis of Gaussian innovations, is a pop- 
, ular method which is widely used for inference in time series models. How- 

I ever, it is often a nontrivial task to establish the consistency and asymp- 

r~| ■ totic normality of the quasi-maximum-likelihood estimator (QMLE) applied 

to specific models and, therefore, an in-depth analysis of the probabilistic 
structure generated by the model is called for. A classical example of this 
kind is the seminal paper by Hannan [18] on estimation in linear ARMA 
time series. 

^ . In this paper we study the QMLE for a general class of conditionally 

H ' heteroscedastic time series models, which includes GARCH, asymmetric 
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GARCH and exponential GARCH. Recall that a GARCH(p, g) [general- 
ized autoregressive conditionally heteroscedastic of order (p, q)] process [4] 
is defined by 

(1.1) Xt = atZt, t G Z, 

and the recurrence equation 

p g 

(1.2) a? = ao + ^ a^Xli + ^ p.a^j , teZ, 

i=i j=i 

where {Zt) is a sequence of i.i.d. random variables with KZq = and KZq = 1, 
and and Pj are nonnegative parameters ensuring the nonnegativity of the 
squared volatility process {a^). The GARCH model has attracted a lot of 
attention in the financial econometrics community because it constitutes an 
example of a stationary time series with a time varying conditional vari- 
ance, hence, conditional heteroscedasticity. There is empirical evidence that 
GARCH captures some of the features of real-life financial return data rather 
well; see the survey article by Shephard [30] and the references therein. 

Although the equations (1.1)-(1.2) look rather simple, they create a com- 
plicated probabilistic structure which is not easily understood. For exam- 
ple, the problem of finding conditions for the existence and uniqueness of a 
stationary solution to the equations (1.1)-(1.2) waited for a solution until 
Nelson [26] provided the answer for GARCH(1, 1) and Bougerol and Picard 
[6] for the general GARCH(p, q) case. Statistical inference leads to further 
nontrivial problems. Since the exact distribution of Zt remains unspecified, 
one determines likelihoods under the hypothesis of standard Gaussian in- 
novations. Moreover, the volatility at is an unobserved quantity. A possible 
approximation of is obtained by mimicking the recursion (1.2), for exam- 
ple, with an initialization X-p^i = • • • = Xq = and = • • • = ctq = 0. 

Recently, Berkes, Horvath and Kokoszka [2] showed under minimal as- 
sumptions that the resulting estimator, which is called the (Gaussian) quasi- 
maximum-likelihood estimator (QMLE), is consistent and asymptotically 
normal, thereby generalizing work by Lumsdaine [24], Lee and Hansen [22] 
and Boussama [7, 8]. Related to [2] is Francq and Zakoi'an [15]. See also 
[1, 17, 25], where the QMLE in the GARCH(p, q) model with a heavy-tailed 
noise distribution is studied. 

Implicitly, the authors of [2] make use of the fact that GARCH (p, q) can 
be embedded in a stochastic recurrence equation (SRE). We focus in this 
introduction on the particular GARCH(1, 1) model in order to illustrate the 
method and to avoid heavy notation. The SRE for is then given by 

= (aiZ2_i + I3i)a^„^ + ao = ^f^t-i + Bt, te Z, 

where At = aiZf__i + (3i and Bt = uq; notice that {{At,Bt)) constitutes an 
i.i.d. sequence. From the literature on SRE's (e.g., [9]), it is well known that 
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the conditions E(log \Aq\) < and E(log''^ I -Sol) < oo guarantee the existence 
and uniqueness of a strictly stationary solution to the SRE 

(1.3) Yt = AtYt.i+Bt, teZ, 

provided {{At,Bt)) is a stationary ergodic sequence. The condition 
E(log l^ol) < can be interpreted as "the \At\^s are smaller than one on av- 
erage." We will refer to this property as the contraction property of the SRE. 
Altogether, applied to GARCH(1, 1), this shows that E[log(aiZ^ + Pi)] < 
is a sufficient condition for the existence of a stationary solution. Nelson [26] 
also gave an argument which shows that E[log(aiZQ + f3i)] < is necessary 
for the stationarity of GARCH(1, 1). Note that the latter condition implies 
Pi < 1 because log(/Ji) < E[log(aiZ^ + Pi)] < 0. 

Now, suppose for the moment that the parameters aQ,ai,Pi of a station- 
ary GARCH(1, 1) are known. The fact that Pi <1 enables us to approximate 
the unobserved squared volatility through the recursion = aQ + aiX^_-^ + 
Picf1_i, t > 1, with initialization CTq > 0. Indeed, the relation \d'i — cj'^\ = 
(/3i)*|'5"o ~ "^ol shows that the error of approximation decays at an exponen- 
tial rate when t — > oo. Likewise, for an arbitrary parameter 6 = {ui,U2,u^)'^ 
with < ti3 < 1, one defines ht{6) = ui + U2Xf_i + usht-i{6), t > I, to- 
gether with the initialization hQ{6) > 0. This means that the conditional 
log-likelihood of (Xi, . . . , X„)'^ given (Xo,cro)'^ under Zt i.i.d. ~AA(0, 1) is 
approximately equal to 

modulo an unimportant constant. We define the QMLE as the maximizer 
9n of Ln with respect to 6. Because of < ^3 < 1, the sequence of random 
functions (/it)j>o can be approximated by a stationary ergodic process (ht) 
such that the error \ht — ht\ decays to zero uniformly on a certain compact 
set and with geometric rate. It turns out that (ht) is characterized as the 
unique stationary ergodic solution to the SRE 

(1.4) ht{e)=ui + u2xli + u3ht^iie), t>i. 

We will specify the relevant normed function space on which we study the 
SRE (1.4) in the subsequent sections. The authors of [2] use the uniform 
exponential decay of \ht — ht\ in order to prove that the maximizer On of 

i..w = -^g(i^+iog 

is asymptotically equivalent to On- It is therefore enough, to ciricilyze 0^^. 
This is a shghtly simpler problem because {{Xf /ht -\-loght)) is a stationary 
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ergodic sequence. The consistency of On then follows by an application of 
standard techniques, and the asymptotic normality of 0„ is shown by a 
Taylor expansion of L'^ together with an application of a martingale central 
limit theorem. Note that formal differentiation of (1.4) with respect to 6 
leads to the SRE 

(1.5) h't = {l,Xl„ht^if + U3h[_^, t>l. 

Since < ua < 1, the linear SRE (1.5) is contractive and admits a unique 
stationary ergodic solution {h[)t>o- It can be shown that h[ indeed coincides 
with the first derivative of ht for all t > 0. By similar arguments, one estab- 
lishes the existence, stationarity and ergodicity of the second derivatives of 
ht, so that the Taylor expansion of is validated. 

The ideas sketched above can be extended and applied to conditionally 
heteroscedastic models of the more general form 

{Xt = (JtZt, 
0"? = 9e{Xt-i, Xt-p, a'^_i,. ■ ■ , cr^-q), 

where p,q>0 are integers, {ge} denotes a parametric family of nonnega- 
tive functions on x [0,oo)'^ satisfying certain conditions and (Zt) is a 
sequence of i.i.d. random variables with E,Zq = and IE^q ~ ^- Essentially, 
this is accomplished under the assumption that "(70 is a contraction." This 
condition is a random coefficient Lipschitz condition, where the Lipschitz 
coefficient has a negative logarithmic moment, analogous to E(logj4o) < 
in the GARCH(1, 1) case. The notion of contractivity will be made precise 
in different forms in the following sections. It is then possible to treat — in a 
unified manner — the QMLE for various other GARCH-type models, such as 
AGARCH (asymmetric GARCH), introduced by Ding, Granger and Engle 
[14], or EGARCH (exponential GARCH), introduced by Nelson [27]. 

The main goals of this paper are the following: (1) studying the gen- 
eral conditionally heteroscedastic model (1.6) with emphasis on the approx- 
imation at of the stochastic volatility at given initial values and (2) quasi- 
maximum-likelihood inference. The novel approach in this paper is to explic- 
itly formulate and solve the relevant problems by making use of stochastic 
recurrence equations (SRE's). This will lead to proofs which illuminate the 
underlying probabilistic structure. 

It turns out that invertihility of the model, that is, the fact that 

I 2 2 1 P 

Wt -^t I — ^0, t^cx), 

is an important condition for the applicability of the QMLE. The verification 
of the invertihility property is a rather straightforward task for the GARCH 
and AGARCH models, but establishing invertihility of EGARCH is an intri- 
cate and unpleasant problem. A final treatment of the QMLE in EGARCH 
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is not possible at the time being, and one may regard this open problem 
as one of the limitations of this model. To the best of our knowledge, the 
theoretical properties of the QMLE in EGARCH have not been studied in 
the literature. 

Work of Boussama [7, 8] and Comte and Lieberman [12] on multivariate 
GARCH indicates that the contraction technique cannot be employed in 
the analysis of the QMLE in multivariate conditionally heteroscedastic time 
series models. 

The paper is organized as follows. In Section 2 we collect some of the 
technical tools to be used throughout this paper. Among them, Section 2.5 
is crucial since it gives conditions for the existence and uniqueness of a 
strictly stationary solution to an SRE with values in abstract spaces. This 
section is based on work by Bougerol [5] . In Section 3 we investigate some of 
the basic properties of the general conditionally heteroscedastic model. We 
start with the problem of existence and uniqueness of a stationary solution 
to the underlying SRE (Section 3.1), discuss the invertibility of the model 
(Section 3.2) and finish with a proper definition of the above mentioned se- 
quence (ht) in the general model (1.6). In Section 4 we establish the consis- 
tency of the QMLE in the general conditionally heteroscedastic model (1.6). 
In Section 5 we verify the conditions for consistency of the QMLE for two 
particular models, AGARCH(p, g), including GARCH(p, g), and EGARCH. 
In Section 6 we study the differentiability of ht as a preliminary but crucial 
step in the proof of the asymptotic normality of the QMLE in the general 
model (1.6) given in Section 7. We verify the conditions for asymptotic nor- 
mality of AG ARCH (p, q) in Section 8. The verification of these conditions in 
the general EGARCH model is an open question. However, in some specific 
models asymptotic normality can be established as well. Since this leads to 
a series of technical calculations, we refer the reader to [31]. In Section 9 we 
briefly indicate that the QMLE is also applicable to certain nonstationary 
solutions of the model (1.6). 

2. Preliminaries. 

2.1. Exponentially fast almost sure convergence. Let T = N = {0, 1, . . .} 
or r = Z. For sequences {vt)t£i,, we write (vt) in abridged form. The following 
definition will facilitate the formulation of many of our results. A sequence 
{vt)teT of random elements with values in a normed vector space {B,\\ ■ ||) 
is said to converge to zero exponentially fast a.s. when t — > c«, henceforth, 
denoted by vt ^-—^ 0, if there exists 7 > 1 with 7*||t't|| 0. 

Lemma 2.1. Let {(,t)teT be a sequence of real random variables with 
(La^. Q [vt)t£T sequence of identically distributed random elements 
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with values in a separable Banach space (i?, || • ||). /f E(log^ ll'^oll) < oo, then 
Y^tLoitVt converges a.s., and one has £,nJ2t=o''^t^~^ ^ ^''^d ^nVn^—^O as 
n — > oo. 

Proof. Since 0, there is a 7 > 1 with 7*|^t| 0. Hence, there 

exists a random variable C > with \^t\ ^ C7~* a.s. for all t G N. It is a well- 
known fact that 7~^ < 1 and E(log"'' ||uo||) < cxd imply X!t^o 7~*ll^t II < ^ ^-S-! 
see, for example, [2]. Therefore, 



H 116^^*11 = 11 161 Iktll <C'Z!^ *lbt|| <oo 

t=0 t=0 t=0 



a.s. 



Since B is complete, this implies that X^f^o ^tVt converges in B a.s. As to the 
second part of the lemma, choose 7 > 1 small enough such that = 7/7 < 
1. Since rj^^'^ < 1 and E(log~^ ll^oll) < imply X^t^o ^*^^ll^tll < ^-^-^ 
estimate 
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t=0 



r?"7"|en| 



t=0 



t=0 



establishes ^nStLo^t as n — > 00 and ^n^^n — ^ 0. This completes the 
proof. □ 



We will often use the following elementary properties without any explicit 
reference. 



Lemma 2.2. Let vi and V2 he two random elements taking values in a 
separable Banach space. Then the existence of a q> such that E||t)i||'^ < 00 
implies E(log''~ < cxo. Moreover, 

E(log+ \\vi + z;2||) < 21og2 + E(log+ ||7;i ||) + E(log+ ||t;2||) 

and 

E[log+(||7;i||||7;2||)] < E(log+ + E(log+ ||7;2||). 

We also need the following auxiliary result. 

Lemma 2.3. Let (It)teT o-i^d {Yt)t£T be sequences with \Yt — Yt\ 
as t ^ 00. Then we have the following: 

(i) |y,|V2_|y^|i/2-_:i--o as t^ 00. 

(ii) //, in addition, {Yt)t£T is stationary with E|lo| < 00, then also \ exp(lt) — 

exp(yt)r^-o. 
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Proof, (i) By assumption on 11^—1^1, there is a 7 > 1 with 7*11^4 — 1^1 0. 
Consequently, there exists to (depending on the reaUzation uj) such that, for 
every t > tQ, either {min(yj,yj) < 7"*, max(Yt,Yt) < 7~*^^} or {min(l^,lt) > 
7~*}. Using this observation and applying the mean value theorem to the 
difference of square roots, we conclude 

\{Yt)'/' - {Yt)'^'\ < max{7-*/^ 2-S*/2|y, - Y,\}, t > t,. 

This shows that 7*1(^4)^/2 _ (-y^)i/2| ^ q if 1< 7 < 7^/^ and, thus, 1(1"*)^/^- 

(ii) As soon as jYi — lt| < 1, by the mean value theorem, 

I exp(y4) - exp(yi)| = exp(y4)|l - exp(yt -Yt)\< exp(l + Yt)\Yt - Yt\. 

Now the claim follows from |lt — l^j together with E[log^{exp(l + 
^0)}] ^ l+IE|lo| <oo and an application of Lemma 2.1. This concludes the 
proof. □ 

The following elementary result about random products is used in abun- 
dance. 

Lemma 2.4. Let {Yt)t£T be a stationary ergodic sequence of nonnegative 
random variables with E(loglo) < 0. Then 

flrr-^O, n^oo. 
t=o 

If, in addition, (Yt)t(^T is an i.i.d. sequence with KYq < 00 for some q> 0, 
then there exist < q <q and <rj <1 such that 

/n-l \9 

Proof. The first assertion follows from a straightforward application of 
the ergodic theorem to the logarithm of nr=o together with E[logyo] < 0. 
Concerning the second claim, observe that the map sh->E|1o|* on [0,q] has 
first derivative equal to E(logyo) < at s = 0. This shows the existence 

q£ {0,q] with rj := EY^ < 1, and since iYt)teT is i.i.d., E(nr=ro^ ^t)^' = 
(EYq^)" = 77", which concludes the proof of the lemma. □ 

2.2. Stationarity and ergodicity. The proofs of the consistency and asymp- 
totic normality of the QMLE rest on the ergodicity of the underlying time 
series. The stationarity and ergodicity of sequences {vt)t£T of random el- 
ements with values in a general measurable space are up to some evident 
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generalizations defined as in the case of sequences of real random variables; 
see, for example, the monograph of Krengel [20]. A standard example of a 
stationary ergodic sequence of random elements is an i.i.d. sequence. For the 
following well-known result, see Proposition 4.3 in [20]. 

Proposition 2.5. Let {E,£) and {E,£) be measurable spaces. If (vt) is 
a stationary ergodic sequence of E-valued random elements and h: {E^,£^) 
{E,£) is measurable, then the sequence (vt) defined by 

(2.1) vt = h{vt,vt-i,...), tGZ, 

is stationary ergodic. 

Since we did not find a proof for the following result in the literature, we 
refer to [31] for details. 

Proposition 2.6. Let {E,£) be a measurable space and E a complete 

and separable metric space, which we endow with its Borel a-field ?= B{E). 
Assume that [vtj is a stationary ergodic sequence of E-valued random ele- 
ments. Let fm '. {E^,£^) — > {E,'P), m G N, be measurable maps such that for 
some to G Z, the sequence fm{vta~i^VtQ-2, • • •) is convergent in E a.s. Then 
there is a measurable map f : {E^'^ ,£^) — > {E^'s) such that, for all t £1^, 

vt= lim fm{vt-i,vt-2,---) = f{vt-i,vt-2,---) a.s., 

m^oo 

and the sequence (vt) is stationary ergodic. 

2.3. Uniform convergence via the ergodic theorem. For establishing con- 
sistency and asymptotic normality of M-estimators, one often needs to show 
the uniform convergence of sequences of random functions. Let us assume 
that K cM.'^ is a compact set. Write C{K,M.'^ ) for the space of continu- 
ous M°' -valued functions equipped with the sup-norm \\v\\k = sup^^^ 1^(^)1) 
and for short, C{K,R) = C{K). Recah that C{K,R'^') is a separable Banach 
space. For a given stationary sequence of random elements {vt)t£T with val- 
ues m we say that the uniform strong law of large numbers holds, 
if in C{K,R'^'), 

1 " 

where the function v is defined pointwise by v{.s) = ¥,[vo{s)] , s £ K. Note that 
the a.s. uniform convergence understands that v S C{K,M.'^ ). In the litera- 
ture the uniform SLLN is often established in two steps. First, by an appli- 
cation of the ergodic theorem for real sequences, J27=i "^tis) v{s), for 
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every fixed s £ K. Second, the uniform convergence is proved by showing the 
a.s. equicontinuity of {n~^J2t=i'^t}- In order to estabhsh the a.s. equicon- 
tinuity of the second derivatives of the log-hkehhood, Lumsdaine [24], Lee 
and Hansen [22] and Berkes, Horvath and Kokoszka [2] stochasticahy bound 
the third derivatives. Such computations can be avoided when the ergodic 
theorem for random elements with values in a separable Banach space is 
applied. We state the relevant result as a theorem and refer to [29] for its 
proof. 

Theorem 2.7. Let (vt) be a stationary ergodic sequence of random el- 
ements with values in C{K,W^ ). Then the uniform SLLN is implied by 
^\\vo\\k < oo. 

2.4. Notation and matrix norms. For a sequence {(pt) of transformations 

on a certain space E, we denote by (<^|^^) the sequence of the n-fold iterations 
of past and present transformations defined by 

M^ridij, r = 0, 

* \ </)t o 0i„i o • • • o r>l, 

where Id^; denotes the identity map in E. 

In this paper we use two different matrix norms, as the case may be; since 
all matrix norms are equivalent, the particular choice of a norm is (mostly) 
irrelevant from a mathematical point of view. Recall that the Frobenius norm 
of a matrix A = (oij) G M*^ ^'^ is defined by 

1/2 

|A|| = (E' 

\ « J 

Occasionally we use the operator norm with respect to the Euclidean norm 
instead, that is, 

HAH 

IJAJlop = sup——. 

x^O |X| 

Finally we define the norm of a continuous matrix- valued function A on a 
compact set K C M"', that is, A e C{K,W^''"^'), by 

UAJl/^ = supllA(s)ll. 

Of course. Theorem 2.7 carries over to sequences of matrices: a stationary 
ergodic sequence of random elements (A^) with values in C{K,W^ ^"^ ) and 
with EjjAolJi^ < oo satisfies 

1 

-VAf-^Mo, n^oo, 

where Mo(s) =E[Ao(s)], s£ K; note that the expected value of a random 
matrix is defined element-wise. 
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2.5. Stochastic recurrence equations. Although we merely work in Ba- 
nach spaces, we present the notion of an SRE in the more general case of a 
complete separable metric space (i.e., Polish space), as it was, for example, 
formulated by Bougerol [5]. Hence, let {E,d) be a Polish space equipped 
with its Borel a-field B{E). Recall that a map (p: E ^ E is called Lipschitz 
if 

(2.2) A(^):= sup (M^Mm.) 

is finite and is called a contraction if A(0) < 1. Also note that A is submul- 
tiplicative, that is, \i ^ and '\\) are Lipschitz maps E ^ E, then 

(2.3) A{(l)oip)<A{(t))A{tl;). 

We consider a process {(pt) of random Lipschitz maps E ^ E with (pti-c) 
being ;B(-E)-measurable for every fixed x € E and t £ Z. In what follows, 
T = N or T = Z. If for a stochastic process {Xt)t<^T with values in E, 

(2.4) Xt+i=(Pt{Xt)^ teT, 

we say that {Xt)t£T obeys the SRE associated with {(pt)- Alternatively, 
{Xt)t£T is referred to as a solution to the SRE (2.4). The following theorem 
due to Bougerol [5] is a stochastic version of Banach's fixed point theorem 
and makes statements about the solutions of (2.4) under the assumption 

that (cpt) is stationary ergodic and that 4>o or a certain r-fold iterate (p^Q^ is 
"contractive on average." 

Theorem 2.8 (Theorem 3.1 of [5]). Let {<pt) be a stationary ergodic 
sequence of Lipschitz maps from E into E. Suppose the following conditions 
hold: 

5.1 There is a y ^ E such that Epog"*" d((/>o(y), y)] < oo. 

5.2 E[log'*' ^(0o)] < CO and for some integer r>l, 

E[log A(4'^)] = E[log A((/<o o • • • o (/.„,+!)] < 0. 

Then the SRE (2.4) admits a stationary solution {Yt)t<^T which is ergodic. 
The following almost sure representation is valid: 

(2.5) Yt= lim (pt-io---o(Pt_^{y), t£T, 



m—too 



where the limit is irrespective of y € E. The random elements Yt are mea- 
surable with respect to the a -field generated by {(pt-k \ k>l}. If {Yt)teT is 
any other solution to (2.4), then 

(2.6) d(Yt,Yt)''-^0, t^oo. 

Moreover, in the case T = Z the stationary solution to the SRE (2.4) is 
unique. 
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Remark 2.9. 1. Note that there are in general many solutions to (2.4). 
Indeed, if T = N, take any z £ E in order to produce a solution 

The elements (j)f}_-^^{z) = (f>t-i o • • • o 4>o{z) are also called the forward iterates 
associated with the SRE (2.4), whereas the elements cpt^i o- • ■o(l)f_^{z) with 
t fixed and m > are called backward iterates. Thus, property (2.5) can be 
read as Yf being the limit of its backward iterates, and relation (2.6) means 
that the forward iterates approach the trajectory of the unique stationary 
solution {Yt)t£T with an error decaying exponentially fast as t— s-oo. 

2. Although it is an easy matter to demonstrate the uniqueness of the 
stationary solution (Yt), this property is not mentioned in Theorem 3.1 of 
[5]. We give an argument for the sake of completeness. Indeed, if (Yt) is yet 
another stationary solution of the SRE (2.4), then by the definition (2.2) 
and the triangle inequality, 

d{Yt,Yt)=d{4'::l{Yt-rn),4-l{Yt~rn)) < A{4-1) d{Yt-.m,Yt_m) 

(2.7) 

< A{c|)^^l){d{Yt.r,^,y) + d{y,Yt.r,^)). 

As shown in [5], as a consequence of S.2, one has 
(2.8) A(<^H)'-^'0, m^oo. 

Since {d{Yt-m,y))mm and {d{y,Yt-m))mm are stationary, a Slutsky argu- 
ment shows that the right-hand side of (2.7) converges to zero in probability. 
For this reason, F{d{Yt,Yt) = 0) = 1, and {Yt)t£T and {Yt)t£T are indistin- 
guishable. 

The following result relates the solutions of an SRE associated with a 
stationary ergodic sequence (0j) of Lipschitz maps with the solutions of a 
certain perturbed SRE. 

Theorem 2.10. Let {B,\\ ■ ||) be a separable Banach space and {(j)t) be 
a stationary ergodic sequence of Lipschitz maps from B into B. Impose the 
following: 

5.1 E(log+||</.o(0)||)<oo. 

5.2 Epog"*" A((/)o)] < oo and for some integer r > 1, 

E[log A(4'^))] = E[log A((/)o o • • • o (/>„,,+i)] < 0. 

Assume that E(log''" ||yo||) < oo for the stationary ergodic solution (It)tGN 
of the SRE associated with {(j)t), which is given by (2.5). Let {(l)t)t£f>i be a 
sequence of Lipschitz maps such that 

5.3 ||0t(O) - (l)t{0)\\ and A{^t - ^t) as t ^ oo. 
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Then for every solution {Yt)t€N of the perturbed SRE, 

Xt+i = MXt), ten, 

one has that 

(2.9) \\Yt-Yt\\''-^0, t^oo. 

Proof. Note that the sequence {<j)t) satisfies the conditions of Theo- 
rem 2.8 with d the metric induced by || • ||. It is sufficient to demonstrate 
||Kj+fcr. — l^s+fcrll as A; — > oo for each s G [0,r); indeed, the latter limit 
relation implies \\Yt — YtW < Z]s=o ll^s+r[t/r] ~ ^s+r[i/r] II as t — > oo. To 
begin with, we establish the auxiliary results 

dr.= Ui'\0)-4'\m"-^0 and 

(2.10) 

ei:=A(<^f)-cArV^-0, t-oo, 

that is, the conditions of S.3 are also satisfied for the r-fold convolutions 
4^ and (pf''^ Note that the limit relation (2.10) is true if r = 1 by virtue of 
S.3. The proof of (2.10) proceeds by induction on r. Indeed, by the triangle 
inequality, for any m > 1, 

||,^^+^)(0)-#+^)(0)|| 

= ||,^tO,^H(0)-<^,o 0^(0)11 

+ \m - ^t) o 4-1(0) - - ^t)m + II (<^* - <^*)(o)ii 

< A{4>t)Utl{0) - 4"^J(0)|| + A(<A* - <^t)||<^S(0)|| + ||<A*(o) - <A*(o)||. 

The e.a.s. convergence to zero of the left-hand side is a consequence of 
A{4>t)<A{^t-(pt) + A{(j)t), E[log+A((/)o)] <oo, the limit relation ||(^2i(0)- 

4-ii0)\\ for every i G [0,m], and E(log+ ||(/'H(0)||) < oo together with 
repeated application of Lemma 2.1. Exploiting the submultiplicativity of A, 
one finds in a similar way that 

A(<^^+^)-0(™+^)) 

< A{4>t)Ai4"^l - cptl) + Ail - cl>t)Ai4"i) "-^ 0, t ^ oo, 

and thus, (2.10) is established. 

" (r) 

If we set Ct = A{(j)l ) and take into account that any map (j) satisfies 

mx)\\ < m^) - m\\ + wmw < h<p)m\ + wmi xGB,we obtain 

ll^+fcr ^+A;r|| 
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+ U's'lr-liysMk-Dr) - 4+kr-liYs+ik-l)r)\\ 
< A{4>^lkr-l)\\tHk-l)r - Ys+ik-l)r\\ + M^^lkr-1 " <^2fc._l) ^.+(^-1). I 

+ii'^ii.-i(o)-0;i._i(o)ii 

= Cs+fcr-l||^s+{fc-l)r ~ ^s+{fc-l)rll + (^s+fer-l || ^s+(A;-l)r II + ds+kr-l)- 

Iterating the latter inequality until k = 1, we receive the final estimate 

ll^+fcr ■^+fcr|| 



(2.11) < (^nc,+fr_i^||K,-y,| 



+ IT ^s+ir-l\{es+er-l\\Ys+{£~l)r\\ + ds+£r-l)- 

We show that the right-hand side of the latter inequality tends to zero 
e.a.s. Set q = A((/)|'^^). An application of the monotone convergence theorem 
to E[log~(co + e)] and an application of the dominated convergence theorem 
to E[log"'"(co + e)] show E[log(co + e)] E[logco] as e | 0. Thus, there is 
eo > such that E[log(co + eo)] < 0, and from Lemma 2.4, it follows that 
nf^=i(cs+fr-i + ^o) — ^ as /c ^ oo. This limit relation together with the 
facts that q = A(((^|''^ — 0^''^) + i\>t^) < et + ct and a.s. et < Sq for all but 
finitely many t's leads to 

k k 

(2.12) Y[ Cs+fr-l < n i^s+£r-l + Cs+fr-l) 0, k^OO, 

and shows that (11^=1 Cs+fr-i)||i^ — Ys\\ 0. As regards the second term 
in (2.11), we use Lemma 2.1 together with (2.10) and E(log''' Hloll) < oo to 

prove that ps+ir-i '■= es-\-ir-i\\ys+{e-i)r\\ +ds+ir-i — when £— > oo. This 
limit result and (2.12) imply the existence of a random variable and a 
number < 7 < 1 so that pg^i^-i ^ ^07^ for all £ > 1. From this bound, we 
obtain 

k / k \ k / k \ 

i=l\i=l+l / l=l\i=(,+l ) 

Since the map b ^ E[log(co + 8)\ is continuous and increasing and E(log cq) < 
0, there exists a > such that > E[log(co + (5o)] > log 7. Set q = Q + Jq 



14 



D. STRAUMANN AND T. MIKOSCH 



and ct = ct + Sq, and note that we are done if we can show 
Z]^=i(ni=£+i Cs+ir-i)7^ — 0. Since (cj) is stationary ergodic and E(logco) > 
log7, we have that 7^(0^=1 Cs+ir-i)~^ — ^ 0. Using the mean value theorem 
together with ct,ct'>So, we conclude 

\{Cs+ir-l)~^ - {Cs+ir^l)~^\ < (1/(5q ) |Cs+ir-l " Cs+ir-l\ 0, i ^ OO, 

and, therefore, the identical arguments as used for (2.12) yield that also 
) 0. This implies the existence of a random variable bo 

with 7^(ni=i Cs+ir-i)~^ < bo for all ^ > 1, so that 

k / k \ k 

n Cs+ir~ip^ <bok'[[cs+ir-l''-^0, k ^ OO. 

e=i\i=e+i ) i=i 

For the last step, we have used ni=i Cs+ir-i — 0, which is a consequence of 
E(log Co) < and |q — q | together with the same arguments as applied 
in the derivation of (2.12). This completes the proof. □ 

3. The model: stationarity, ergodicity and invertibility. We consider the 
general conditionally heteroscedastic model 

{Xt = atZt, 
^"t = 9e{Xt^i,Xt-2, ■ ■ ■ ,Xt-p;a^^i,at_2^ ■ ■ ■ ^'^t-q)^ 

where {ge :0 (z 0} denotes a parametric family of nonnegative functions on 
MP X [0, oo)'^ and (Zt) is a sequence of i.i.d. random variables with EZq = 
and EZ^ = 1. We also assume that at is nonnegative and jr^_i-measurable, 
where 

J't = (T{Zk;k<t), teZ, 

denotes the cr-field generated by the random variables {Zi^;k < t}. In the 
context of the latter model we introduce the notation 

Xt = (Xj, . . . ,Xt„p+i)^ and (Tt = {at,. . . ,at_q+i)'^ , 

and write = g0(X.t-i,'^t-i) short. 

In Section 3.1 we investigate under which conditions there is a stationary 
solution {{Xt,at)) to (3.1). In Section 3.2 we study the invertibility of this 
stationary solution. In Section 3.3 the function ht, which was discussed in 
the Introduction of this paper, will be properly defined for model (3.1). 
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3.1. Existence of a stationary solution. Here and in the following section 
we suppress the parameter 9 in our notation because for the treatment of 
stationarity and invertibility 6 can be assumed as fixed. In order to discuss 
the stationarity issue, we first embed model (3.1) into an SRE. To this 

end, introduce fccr? = (<^i , • • • , c^t^-fc+i)'^ ^^'^ fc^* = i^t^ • • • ' ^t-k+i)'^ for 
k = max(p, g). Then by substituting the Xf-i^s by Zt-iOt-i in the second 
equation of (3.1), we observe that (fccr^) is a solution of the SRE 

(3.2) St+i=Vt(st), tez, 
on [0, oo)^ , where 

(3.3) Vt(s) = (5(s^^^ feZj, s), si, . . . , Sfc_i)^, 

with s^/^ = (s}^^, . . . , s^^^)-^ for s E [0,oo)^; recall that stands for the 
Hadamard product, the componentwise multiplication of matrices or vec- 
tors of the same dimension. On the other hand, if a stationary sequence (sj) 
is a solution of (3.2) and is measurable with respect to J-t~i, then the 

sequence ((sJ^^Zt, s|(^)) (here s|(^ denotes the first coordinate of s^^) is 
stationary and obeys the equations (3.1). Hence, for proving the existence 
and uniqueness of a stationary sequence {{Xt,at)) satisfying (3.1) and 
being .Fj_i-measurable, we may focus on showing that there exists a unique 
stationary nonnegative solution (s^) to (3.2) for which Sj is .Ft_i-measurable. 
After noticing that {ipt) is stationary ergodic, an application of Theorem 2.8 
with {(j)t) = (tpt) and d the Euclidean metric results in the following propo- 
sition. 

Proposition 3.1. Fix an arbitrary <Jq G [0,oo)'^ and suppose that the 
following conditions hold for the stationary ergodic sequence {ipt) of maps 
defined in (3.3).' 

5.1 E[log+|Vo(«?g)|]<oo. 

5.2 E[log~'' A('i/;o)] < oo and for some integer r > 1, E[log A('0q''^)] < 0. 

Then the SRE (3.2) admits a unique stationary ergodic solution (fcC^ ) such 
that fcCTj is J^t-i-fneasurahle for every t G The following almost sure rep- 
resentation is valid: 

(3.4) fcO-?= lim Vt-i o---oV't-m(<?o)i t^Z, 

m — >oo 

where the latter limit is irrespective of c^q. For any other solution (k^t) of 
the SRE (3.2) with index set Z or N, 

(3.5) IfcO-f -fccr^l ^'0, t^oo. 
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Remark 3.2. In general, the stationary distribution induced by the 
SRE (3.2) is not known and, thus, perfect simulation of {(Xt,at))t£n is 
impossible. The following algorithm provides an approximation with an error 
decaying e.a.s. 

(1) Take an initial value <Jo G [0,00)*^, set = <Jo, and generate k^t 
according to (3.2). 

(2) Set iXt,at) = {k^l,)^/HZt,l), t = 0,1, . . . . 

From Proposition 3.1, it is immediate that |cjf — cr|| as i — > 00. More- 
over, by virtue of Lemmas 2.1 and 2.3, we can conclude \Xt — Xt\ = \Zf\\at — 

I e.a.s. „ 

at\ — > (J as I —> 00. 

We now discuss two examples of conditionally heteroscedastic time se- 
ries models of the form (3.1), which are well-known from the econometrics 
literature. 

Example 3.3. In its simplest form, the exponential GARCH model 
(EGARCH) of Nelson [27] has a volatility obeying the SRE 

(3.6) loga2 = a + /31ogcj2_i+7Zt_i+(^|Zt_i|, teZ, 

where a, 7, (5 G M and < 1. In other words, the sequence (log ctj) con- 
stitutes a causal AR(1) process with innovations sequence (a -|- ^Zt-i + 
5\Zt-i\). Although EGARCH falls into the class of models defined by (3.1), 
we avoid writing the SRE (3.6) in the form = g{Xt„i,a^_i) since this 
would unnecessarily complicate the question of stationarity. Instead, we ap- 
ply Theorem 2.8 to the SRE 

(3.7) loga2+i=Vt(Ioga2), teZ, 
where 

Ms) = a + Ps + jZt + 6\Zt\, tez. 

We recognize that \(3\ < 1 together with E[log^(a + 7Z0 + 5|Zo|)] < 00 is a 
sufficient condition for the existence of a unique stationary solution to (3.7); 
since KZq = 1, the innovations (a -|- 7.^4-1 + (5|Zt_i|) automatically have a 
finite positive logarithmic moment. By taking the limit of the backward it- 
erates associated with the SRE (3.7), it is straightforward to see that the 
unique stationary solution (logcr^) of (3.7) has the almost sure representa- 
tion 

00 

(3.8) loga2 = a(l-/3)-i + ^/3'^(7Zt_i_fc + 5|Zt_i„fc|), t G Z, 

k=0 

which is well-known from the theory of the causal AR(1) process; see, for 
example, [11]. 
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Example 3.4. In the AGARCH(p, q) model [asymmetric GARCH(p, q)] , 
which was independently proposed by Ding, Granger and Engle [14] and 
Zakoi'an [33], the squared volatility is of form 



(3.9) = ao + J2 " 7^t-i)' + E ^^i^: 



2 



i=l 



where oq > 0, ai,(3j > and I7I < 1. Note that 7 = in AGARCH(p,g) 
corresponds to a GARCH(p, g) process. One may apply Proposition 3.1 in 
order to study the stationarity of AGARCH, but the resulting sufficient 
conditions will not be very enlightening. Instead, we adapt the particular 
methods developed in [6] for the treatment of GARCH(p, q) and derive an 
SRE with i.i.d. linear random transition maps. This leads to a more insightful 
theory. To this end, consider the associated sequence (Yj) given by 



(3.10) 



2\T 



(l-'^i-il - iXt-i) {\Xt-p+i \ - jXt-p+i 
One easily verifies that Xt = cTtZt together with (3.9) implies 
(3.11) Yt+i = AtYt + Bt, tGZ, 

where the {p + q — I) x {p + q — l)-matrix valued i.i.d. sequence (At) and 
the vectors (B^) are defined through 



At 



(3.12) 



1 

1 



{\Zt\-^Ztf 




/3q_i I3q 02 as 













10 





' 







oJ 



Bt = (ao,0,...,0)^GlR^'+«-\ 

A straightforward argument yields that there is a unique stationary 
AGARCH(p, g) process {{Xt,at)) if and only if the SRE (3.11) has a unique 
stationary nonnegative solution such that Y^ is .7-t_i-measurable. By em- 
ploying the identical arguments as in the proof of Theorem 1.3 in [6], the 
SRE (3.11) has a unique stationary solution if and only if the top Lyapunov 
exponent associated with (At) is strictly negative, that is, 

(3.13) p= lim ^— E(log||Ao---A_„+i||op)<0. 
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Here || • ||op denotes the matrix operator norm with respect to the Euchdean 
norm on M^^'^"^. Moreover, this stationary solution is ergodic and measur- 
able with respect to J-t~i with almost sure representation 

oo / k \ 

(3.14) Yi = 5^ mAt-HBj.fe, tGZ. 

k=o\i=i I 

Here by convention n?=i • = 1- Furthermore, one demonstrates along the 
lines of the proof of Corollary 2.2 in [6] and the remark following it that 

(3.15) X]«*^[(l^o|-7^o)'] + E/5j-<l 
i=\ j=i 

is sufficient for stationarity and implies EXq < oo. This property general- 
izes the necessary and sufficient condition of [4] for weak stationarity in 
GARCH(p, q) processes to the AGARCH class. Arguing as in Corollary 2.3 
of [6], one finds that 

q 

(3.16) E/^i<l 

is necessary for stationarity of AGARCH(p, q). To the best of our knowledge, 
these results do not appear in the literature, for which reason we summarize 
them in the form of a theorem. 



Theorem 3.5. The AGARCH(p, g) equations Xt = atZt and (3.9) ad- 
mit a unique stationary solution if and only if (At) has top Lyapunov ex- 
ponent p<0. Moreover, this stationary solution {{Xt,at)) is ergodic, at is 
Tt-i-'nn.easurable, and the vector Yt given in (3.10) has almost sure rep- 
resentation (3.14). The restriction (3.16) on the parameters is necessary 
for stationarity, and the condition (3.15) is equivalent to the existence and 
uniqueness of a stationary AGARCH(p, g) process with finite second moment 
marginal distribution. 

Remark 3.6. The sufficiency of p < for the existence of a stationary 
solution to (3.11) is a direct consequence of Theorem 2.8. Indeed, the SRE 
(3.11) can be written as Y^+i = '0((Yj), where ipt{y) = A^y + Bj. It is clear 
that A(4™^)<|| Aq Hop — II Aq • • • A„m,+i Hop for all m G N. By definition of 
the top Lyapunov exponent, there is an r > 1 such that E(log ||Aq''^||op) < 
and, hence, the conditions of Theorem 2.8 are met with ((f>t) = {ipt) and d the 
Euclidean norm; note that the technical assumption S.l and E[log^ A('0o)] = 
E(log^ 1 1 Aq 1 1 op) < oo trivially follow from E||Ao||op < oo, which is a conse- 
quence of EZq = 1 and the fact that every matrix norm is equivalent to the 
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Frobenius norm. The definition (3.13) of the top Lyapunov exponent and 
p < imply 

||At_i • • • At_m||op 0, m^oo. 

The latter property can be used for determining the limit of the backward 
iterates associated with (3.11), resulting in the representation (3.14). We 

also mention that E|Yo|^ < oo for some q>0. Indeed, E(log || Aq^^ ||op) < 
together with Lemma 2.4 implies the existence of g > and <rj <1 such 
that 

Cm \Q 
ni|ALVi).llopj =V'^, rn>l. 

Without loss of generality, q <1. Since E||Ao||op < oo, also E||Ao||fp < oo. 
The identity (3.17) together with the facts that || • ||op is submultiplicative 
and (A() is i.i.d. demonstrates 

E||a(^)||^p < (E||A(^)||fp)[^^/^''](E||Ao||fp)^^-[^'/^l < crjl'/^\ k > 0, 

where c = max(l, (E|| AoHop)''). Finally, by an application of the Minkowski 
inequality, 

oo oo 

(3.18) EllYill^p < 5^E||Af )||fpE|Bor" < c^^r?!'^/^^] < oo. 

k=0 fc=0 

3.2. Invertibility. For real-life data sets which we assume to be generated 
by a model of type (3.1), the volatility at will be unobservable. In such a 
case, it is natural to approximate the unobservable squared volatilities from 
data X_p_|_2, ... in the following way: 

Initialization: 

(1) Set <To = ^0' where <fQ G [0, oo)^ is an arbitrarily chosen vector. 
Recursion step: 

(2) Let o-f_^_i = cj)t{d'1) for t = 0, 1, 2, . . . , where the random functions (j)t are 
defined as 

(3.19) (/.t(s) = (<7(Xt,s),si,...,s,_i)'^, s = (si,...,s,)^G [0,00)-?. 

In the context of our nonlinear model we say that the unique stationary 
ergodic solution [{Xt^at)) to the equations (3.1) is invertible [or model (3.1) 
is invertible] if 
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In other words, invertibility guarantees that the above algorithm converges. 
There is a second interpretation, which at the same time clarifies the rela- 
tionship between invertibility in ARMA models and our notion. Note that 
(<T^)jgN is a solution of the SRE 

st+i = (f>t{st), ten, 

on [0,00)'^ and recall that the backward iterates associated with {(pt) are 
defined by 

2 2 

f^t,m = 4>t-lO---0(l)t-m{<il), m>l, 

for t Observe the relationship = a^^ for all t > 0. Furthermore, since 
we suppose that {{Xt,at)) is stationary, ((ctj ^,<t^)) is stationary for every 
fixed m > (Proposition 2.5). Thus, 

2 2ii2 2_'2 2 

^t,m — ^m,m — ""m ""m) m ^ U. 

Therefore, invertibility is equivalent to 

(3.20) al^^aj, m^oo, 

for every t £ Z. Relation (3.20) together with Proposition 2.6 and a sub- 
sequence argument implies the existence of a measurable function / such 
that 

^1 = f{Xt-i,Xt-2,...) a.s. 

for every t E Z. If we impose (t| > a.s. for the model (3.1), the invertibility 
allows us to represent Zt as a function of the past and present observations 
{Xt_k\k > 0}. Compare this with the notion of invertibility in ARMA mod- 
els. Recall that an ARMA(p, q) model with parameters (ai, . . . , Op, . . . , I3q)^ 
is a stochastic process {Xt) which obeys the difference equation 

V 1 

Xt = Y^a,Xt-^ + Y, (3, Zt-j + Zt, tez, 
i=i j=i 

where (Zt) is a given white noise sequence with mean zero and finite variance 
o"^; see [11]. Invertibility is defined as follows: there exists an absolutely 
summable sequence of constants (vrj)j>o such that Zt = J2'j^o'^j-^t-j ^-^-^ 
or, in other words, the innovation at time t is a linear functional of the past 
and present observations {Xt-k | A: > 0} . If the two characteristic polynomials 
a{z) = 1 — J2'i=i and /3(z) = 1 + J2'j=i PjZ^ have no common zeros, then 
the ARMA process is invertible if and only if (3(z) ^ for all z G C such that 
\z\ < 1; see, for example. Theorem 3.1.2 in [11]. For nonlinear time series 
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models, however, the invertibihty issue can be a hard problem. Our notion 
of invertibihty is an adaptation of the notion introduced by Granger and 
Andersen [16] in the context of a general nonlinear autoregressive moving 
average model. The following proposition is an immediate consequence of 
Theorem 2.8 with d the Euclidean metric. 

Proposition 3.7. Assume that there exists a unique stationary ergodic 
solution {{Xt,at)) to the model (3.1). Suppose, in addition, for {(pt) given 
in (3.19); 

5.1 E[log+|,/)o(^§)|]<oo. 

5.2 E[log+ A((?!)o)] < oo and for some integer r > 1, E[log A((/)o''^)] < 0. 

If there exists r > 1 with E[log A(0q''^)] < 0, then {{Xt,at)) is invertible. In 
particular, irrespective of <fQ , 

1-2 2| e.a.s. „ 

|<Tj — <Tj I > 0, t ^ OO. 

Example 3.8 (Continuation of Example 3.3). Assume < /3 < 1, j + 6 > 
0, 5 — 7 > for the parameters of EGARCH. This restriction also seems 
reasonable from an economics point of view. One expects a positive rela- 
tionship between volatilities on successive days, that is, /? > 0. The squared 
volatility erf as a function of Zt-i should be nondecreasing on the positive 
real line (i.e., 7 + 5 > 0) and nonincreasing on the negative real line (i.e., 
(5 — 7 > 0). Altogether 7^ + > for all z G M. As we mentioned in Ex- 
ample 3.3, it is beneficial to consider the SRE for (logcj|), which slightly 
differs from the general setup of this paper. From (3.8), one concludes that 
log cr| > a(l — (3)~^ so that we may interpret (3.6) as an SRE 

(3.21) logai% = 0i(logcT2), tGZ, 
on the (restricted) set / = [a(l — /5)"^,oo), where 

Ms) = a + (5s + {jXt + 6\Xt\)eM-s/2). 

Let us determine A.{(j)Q). Since (po is continuously differentiable, A(i;^o) = 
sup^g/ |(/)q(s)|. Maximizing 

\(f>'o{s)\ = \P-2-\jXo + 6\Xo\)exp{-s/2)\ 

over /, we obtain 

(3.22) A(0o) = max(/3, exp(-a(l - (3y^/2){^Xo + 6\Xo\) - P). 

It does not seem to be possible to derive a tractable expression for A((^g'^^) 
when r > 1 and it is not clear how to find a bound sharper than the trivial 
bound A(i;^q'"^) < A((/>o) • • • A((/)_,.-|_i). Recalling the representation (3.8) and 
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substituting Xq by (TqZq in (3.22), the condition E[log A(i?io)] < 0, which 
impUes invertibihty, reads 



E 



(3.23) 



log max<^ /?, 2-^ exp 2"! ^ (3'' (7^-fc-i + ^1 ^-fc-i I ) 

I V fc=o y 

X (7Zo + 5|Zo|)-/? 



<0. 



In practice, one would have to rely on simulation methods for its verification. 

Proposition 3.9. Let {{Xt,at)) he a stationary ergodic of the EGARCH 
process with the parameter constraints < /3 < 1, (5 > I7I . Then the condition 
(3.23) is sufficient for invertihility since 



(3.24) 



2| o.a.s. 

t I ^ 



0, 



t 



00. 



Proof. By an application of Theorem 2.8 to the SRE (3.21), one has 
I logo"! ~ loS*^* I 0- Taking the expectation in (3.8) and accounting for 
E\Zt\ < (£^^2)1/2 = 1^ we obtain E(loga§) < (a + 5){1 - < 00. Conse- 
quently, (3.24) is valid by virtue of Lemma 2.3. □ 



Remark 3.10. The case (3 = leads to a simpler condition and illus- 
trates that there exist invertible EGARCH models. For (3 = 0, the condi- 
tion (3.23) becomes -log2 + (<5/2)E|Zo|+E[log(7Zo + 5|Zo|)] < 0. Note that 
6 < 1 implies the latter condition. Indeed, using E|Zo| < (EZ^)i/2 = 1 and 
E(7Zo + 6\Zo\) <d<l, Jensen's inequality yields E[log(7Zo + d\Zo\)] < 0. 
From the relation 1/2 < log2, one obtains ((5/2)E|Zo| — log2 < 0, which 
proves the assertion. 

Example 3.11 (Continuation of Example 3.4). For the AGARCII(p, q) 
model, the random maps (3.19) are affine linear, that is. 



where 



ao + J2ai{\Xt+i_i\ - -fXt+i^if ei + Cs, se [0,00)", 



i=l 



(1,0,. 


..,0)^Gl 






/?2 ••• 




1 


••• 








1 








... 


10 


Vo 
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Observe that A((/)q ) < ||C'"||op for any r G N (the inequahty in the latter 
relation is a consequence of the fact that the domain of (pt is but a subset of 
M*^). In order to prove log HCHop < for large enough r, first recall that a 
necessary condition for stationarity in AGARCH(p, q) is /?e := Z]j=i < 1- 
Arguing by recursion on q and expanding the determinant with respect 
to the last column, it can be shown that C has characteristic polynomial 
p{\) = det(AI - C) = A'?(l - El=i/?jA-^). If |A| > fi]!'' , then by repeated 
application of the triangle inequality together with < < 1, 

\p{\)\ >i-j2m-'>^-ji PjPi''' > 1 - /9s' E = 0- 

j=l j=l j=l 

Consequently, the matrix C has spectral radius strictly smaller than P^^'^ ■ 
By the Jordan normal decomposition, this entails 

(3.25) ||Cn|op<c/3^/^ r>0, 

where c is a constant depending on q and /3s, and thus, log A((/)q''^) — > — oo. 
This means that the conditions of Proposition 3.7 are met for stationary 
AGARCH(p, g) processes. Consequently, every stationary AGARCII(p, g) 
process is automatically invertible. It is also possible to give an explicit 
representation of in terms of {Xt^i, Xt^2, • ■ ■)', see equation (5.6) below. 



3.3. Definition of the function hf. In this section we do not suppress the 
parameter 9 any more, that is, we write cr^_^_i = gff{X.t,a^). Assume that 6 
belongs to some compact parameter space K C and that {{Xt,at)) is the 
unique stationary ergodic solution to the model (3.1) with unknown true 
parameter = 0q. For any initial value <Jo G [0, oo)'', we define the following 
random vector functions hj on K: 



(3.26) ht 



4^ t = 0, 



$t-i(ht„i), t>l, 
where the random maps ■ C{K, [0, oo)'') C(/^, [0, oo)'') are given by 

We can regard h.t{0) = {ht{6), . . . , ht-q+i{6))'^ as an "estimate" of the squared 
volatility vector <Tj under the parameter hypothesis 0, which is based on the 
data X_p_|_i, . . . , Xt. Also observe that ht(0o) = ^"t for all i € N. 

For establishing the consistency of the QMLE, it is essential that one 
can approximate {ht)t<m by a stationary ergodic sequence {ht)t&n such that 
the error ht — ht converges to zero sufficiently fast as t — > oo and such that 
{ht{0)) = (erf) a.s. if and only if = 6q; see Theorem 4.1. In particular, these 
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requirements on {ht)t£fq comprehend the invertibihty of the time series (Xf) 
because ht{OQ) = a^. Invertibihty is a common assumption in the classical 
theory of parameter estimation in ARMA time series. Only recently have 
certain aspects of estimation in noninvertible linear time series been studied; 
see, for example, [13] or [10]. 

For finding a candidate for such an approaching sequence, first observe 
that (ht)f(=N is a solution of the SRE 

(3.27) st+i = M^t), ten, 

on C{K,[0,oo)'') (provided certain regularity assumptions on ge are ful- 
filled). Theorem 2.8 at hand, it is clear that if $0 or one of its r-fold con- 
volutions is a contraction on average, then the unique stationary ergodic 
solution of the SRE (3.27) with index set Z provides the desired sequence 
(ht). We summarize our findings in a proposition. 

Proposition 3.12. Assume that model (3.1) admits a unique station- 
ary ergodic solution {{Xt,a't)) and that the map {0,s) gQ{x,s) is continu- 
ous for every x G R^', which implies that {^t) is a stationary ergodic sequence 
of mappings C{K, [0, ooy) — > C{K, [0, oo)'^). We suppose the following con- 
ditions hold: 

1. E(log+||<I>o(^g)||i^)<oo. 

2. E[log''' A(<l>o)] < 00 and there exists an integer r > 1 such that 
E[logA($f^)] <0. 

Then the SRE (3.27) (with the index set N replaced by has a unique sta- 
tionary solution (ht), which is ergodic. For every t G the random elements 
ht are J^t-i-fneasurahle and hj(0o) = '^1 ^-S- Moreover, 

(3.28) ||ht -hflli^^-^'O, t^oo. 

Proof. The existence and uniqueness of a stationary ergodic solution 
to (3.27) and the limit relation (3.28) are a direct consequence of Theo- 
rem 2.8. It remains to give arguments for the remaining assertions. The 
backward iterates associated with (3.27) are given by 

^^•^^^ ^''"^ = { I'll o • • • o ^t-mi<il), Z>1. 

This reveals that they are of the form ^ = fm{Xt-i,Xt-2, ■ ■ ■) for certain 
measurable maps fm- Since ht^m as t — > 00, an application of Propo- 

sition 2.6 shows that ht = f{Xt-i,Xt-2, ■ ■ ■) a.s., where / is measurable. 
From this we conclude that hf is -measurable for every t. The relation 
ht(0o) = f^t follows from 

h/Q \ 2 2 2 <i ^ 2 2 



QMLE IN CONDITIONALLY HETEROSCEDASTIC TIME SERIES 



25 



together with |(t^ — <t^| ^-^^ 0, as shown in Proposition 3.7. □ 

4. Consistency of the QMLE. Suppose we observe data X_p_|_i, . . . ,Xo, 
Xi,. . . , Xn generated by the model (3.1) with 0q as the true parameter; here 
we have to emphasize that by a shift of the index we can always assume that 
the data . . . ,Xq are available to us. By this convention, hi is then 

well defined. As in the GARCH(1, 1) case discussed in the Introduction we 
define the conditional Gaussian likelihood by 

(4.1) U6) = --Y^(^ + loghti9)), 

where ht is the first coordinate of the random vector function = (/if , . . . , 
ht-q+i)'^ defined in (3.26). The function ht(0) serves as an estimate of the 
vector <t| = (a^ , . . . , a^_^^^) under the parameter hypothesis 0; see Sec- 
tion 3.3. The QMLE On maximizes L„ on K, where K is an appropriately 
chosen compact subset of the parameter space 0, that is, 

(4.2) 0„ = argmaxL„(0). 

Assume that the conditions of Proposition 3.12 are satisfied. Then ||hf — 
hf IIk ^—^ as t — > oo, where (ht) is the unique stationary solution of the SRE 
Sf+i = $j(sf), t G Z. Then, following the ideas presented in the Introduction, 
we define 

(4.3) L„(fl, = -_g(_L_ + l„,,,(,)) 

together with 

(4.4) 0„ = argmaxL„(0). 

From a theoretical point of view, it is more convenient to work with (Ln) be- 
cause {X'^ / ht + log ht) is stationary ergodic, whereas {Xf /log ht + log ht)t£N 
is not. In what follows, we give a set of conditions which implies the strong 
consistency of 0„: 

C.l Model (3.1) with 6 = Oq admits a unique stationary ergodic solution 

{{Xt,at)) withE(log+a2)<oo. 
C.2 The conditions of Proposition 3.12 are satisfied for a compact set K dQ 

with 9oeK. 

C.3 The class of functions {gelO € K} is uniformly bounded from below, 
that is, there exists a constant g > such that gei^, s) > 5 for all (x, s) G 
RP X [0, oo)9 and OgK. ~ 
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C.4 The following identifiability condition holds on K: for all K, 

ho(6) = aQ a.s. if and only if 6 = 6q. 
C.5 The random elements (r'^/hQ and log/iQ have a finite expected norm, 



E 



4 



< oo and E|| log /io||a- < oo. 

K 



ho 

These conditions are similar to those of [19]. 

Theorem 4.1. Under the conditions C.1-C.4, the QMLE On is strongly 
consistent, that is, 

Proof. In the first part we give the proof under the additional con- 
dition C.5 which allows one to apply Theorem 2.7 to In the second 
part we will indicate that C.5 is not needed. We have chosen to give two 
different proofs because the use of the uniform strong law of large numbers 
is intuitively more appealing than the proof without C.5. 

Part 1. Assume C.1-C.5. First we show that Ln/n L in C{K) as 
n — > oo , where 

Second, we need to prove that L is uniquely maximized at 6 = 9q. In the 
third step we show that the a.s. uniform convergence of Ln/n toward L 
together with the fact that the limit L has a unique maximum implies strong 
consistency. 

(i) We first establish Ln/n L in C{K) by an application of Theo- 
rem 2.7. Proposition 3.12 shows that the sequence (it) = /ht + 
log /if) of random elements with values in C{K) is of the form (it) = {f{Xt, 
Xf^i, ...)), where / is measurable, and hence, stationary ergodic (Proposi- 
tion 2.5). Since Xq = a^Zo with Zq independent of ctq and /iq and EZq = 1, 
assumption C.5 implies EUXq/ZioUe- = E||(7o//io||i^ < oo. Altogether, 
IE||-^o||i^ < so that Ln/n L by Theorem 2.7. The property Ln/n L 
follows if we can demonstrate — LnHx/n 0. Since ht,ht > g > 0, 
an application of the mean value theorem leads to ||(/if)~^ ~ {ht)~^\\K < 
g~^\\ht — htWx and ||log/if — log/ij||ic < g~^\\ht — ht\\K- Thus, there exists 
c > with 

n oo 

\\Ln - Ln\\K < C^(l + X^)\\ht - ht\\K < C^(l + X^)\\ht - ht\\K- 
t=l t=l 
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By Proposition 3.12, \\ht — hi\\x — ^ and by condition C.l together with 
EZ^ = 1 and Lemma 2.2, we have E[log+(l + X^)] < cxo. An apphcation of 
Lemma 2.1 demonstrates Y^tLii^ + ~ ^t\\K < oo a.s. Hence, — 

Ln\\K/n and Ln/n L, as claimed. 

(ii) For the uniqueness of the maximum of L on we need to prove 
that L{0) < L{6o) for ah 6 e K \ {Oq}. Since EflogcJo] is finite and does 
not depend on the parameter 0, we can equivalently demonstrate that the 
function 

is uniquely maximized at 6 = 6q. One can verify that log(a;) — x < —1 for 
all X > with equality if and only if x = 1. Hence, Q{0) < — 1 = Q{Oq) with 
equality if and only if aQ/ho{6) = 1 a.s. By C.4, aQ/ho{6) = 1 if and only if 
9 = Oq, which shows that Q and L are uniquely maximized at 6 = 6q. 

(iii) Showing that (i) and (ii) imply strong consistency is accomplished 
by using standard arguments, which go back to [32]. 

Part 2. Without C.5 there is no longer uniform convergence of Ln/n 
toward L. The proof of strong consistency rests on an argument by Pfanzagl 
[28]. By virtue of Proposition 3.12 and C.3, the function 

is continuous on K with probability 1. Since, for every fixed 6 € K, the se- 
quence {it{6)) is stationary ergodic, one has that n~^Y^^=i^t{'9) L{6) = 
E[^o(^)] as n — > oo by an application of the ergodic theorem for real random 
variables; note that if EXq = oo, the latter limit can take the value — oo at 
certain points 6, but /lo(^) > 5 > guarantees L{6) < +oo for all 6 G K. 
Therefore, we can use exactly the same arguments as given in the proof of 
Lemma 3.11 of [28] in order to show that the function L is upper semicontinu- 
ous on K and limsup„_,oo sup^gj-^/ Ln{9)/n < supgg^/ L{0) with probability 
1 for any compact subset K' C K. Since C.1-C.4 imply — Ln\\K/n 0, 
the inequality limsup„^oQ supgg^^/ Ln{6)/n < sup^g^/ L{6) a.s. is valid also. 
Because an upper semicontinuous function attains its maximum on compact 
sets, one can demonstrate 0n Oq, similarly to step (iii) of the proof of 
Part 1. □ 

5. Examples: consistency. For the purpose of illustration, we apply The- 
orem 4.1 to EGARCH and AGARCH(p,g). Our task will be to define the 
set K in an appropriate way and to verify the conditions C.1-C.4. 
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5.1. EGARCH. Subsume the EGARCH parameters a, /3, 7 and 5 into 
6 = (a, (5, 7, 5y and denote by Oq = (ao) /5oi TOi <^o)"^ the true parameter vec- 
tor. As discussed in Example 3.8, we suppose < /3o < 1, 5q> |7o|. The 
parameter space is of the form = M x [0, 1) x De, where 

The compact set K (ZQ wih be defined below. The restriction < /9o < 1 
guarantees that the SRE (3.7) has a unique stationary ergodic solution 
(logo"^). From the almost sure representation (3.8) of this solution, one rec- 
ognizes E(log(TQ) < 00, which establishes C.l. 

Rather than checking condition C.2 of Theorem 4.1, we directly verify its 
consequences which were used in the proof of the latter theorem, namely, 
the fact that a stationary ergodic sequence (/ij) of random elements with 
values in C{K, [0, 00)) can be defined such that 

(5.1) /it is JT^-i-measurable and ht{OQ)=af a. s. for every t, 
-^tW^T^ ~ ^T^Wk ^—^ and II log/ij — log/ij||/i' 

(5.2) 

as 00. 

To this end, we consider the SRE 

(5.3) log Sf+i = $t(log Si), t£Z, 
where 

[Ms)m = a + l3logs{e) + {jXt + 6\Xt\)eM-s{0)/2), OeK. 

Observing that (7Xt + 5|Xj|)exp(— s(0)/2) > 0, we find that for any constant 
function s = log<;"Q and e > the forward (and backward) iterates associated 
with (5.3) satisfy 

\oght{e) = [$2i(log?2)](0) > a(l + /3 + • • • + /3*-^) + /3*log?o' 
>a{l-l3Y^-e 

for large enough t. Therefore, we may suppose without loss of generality that 
the SRE (5.3) lives on the subset 'C{K, [m — e, 00)) with m = infgg/^ a(l — 
By comparison with the derivation of (3.22), one recognizes that 

A($o) = sup Xe{e) = WXsWk, 

where 

(5.4) Ae(6>) = max(/?,2-^exp(-(m-e)/2)(7Xo + (^|A:o|) -;9), OeK. 

Since E(log HAgHii') ^ E(log ||Ao||/<) as e | 0, the condition E(log HAoHi^) < 
implies E(log HAellx) < for small enough e. Hence, if we assume K is 
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chosen such that E(log || AoHir) < 0, then the sequence (A(<I>j)) obeys the 
conditions of Theorem 2.8, and thus, the SRE (5.3) (on C{K, [m — e,oo)), 
where e > small) admits a unique stationary solution (log /it), which is 
ergodic. Moreover, log ht is .Ft_i-measurable and the property ht{0) = /it(0o) 
a.s. follows from similar arguments as in the proof of Proposition 3.12. Thus, 
(5.1) is established. As regards the verification of (5.2), note that || log /it — 
loghtWK -^0 by Theorem 2.8. The mean value theorem applied to the 
function together with the facts that log ht>m — e for t large and 
log ht>m for all t yields a constant c> with 

x2||(/it)"i-(/it)-^||x = x2||exp(-log/it)-exp(-log/it)||x 

< 1 1 log /it -log /it I 

The latter limit relation is a consequence of E(log^XQ) < oo, implied by 
E(log(TQ) < oo and lE(-^o) ~ ^^"^ application of Lemma 2.1. This com- 
pletes the demonstration of the limit relations (5.2). 

Since condition C.3 is automatically satisfied for the EGARCH process, 
we are left with the verification of the identifiability condition C.4. Before 
we start, we impose the mild technical assumptions that (70,(^0) 7^ (0)0) 
and that the distribution of Zq is not concentrated at two points. Note 
that the case 70 = <Jo = would lead to an identifiability problem because 
then logfTj = ao(l — Po)"^ by representation (3.8), which implies that there 
are infinitely many parameters leading to the identical model. Observe that 
ho{6) = ctq a.s. is equivalent to loght{6) = log/it(0o) a-s. for all t G Z because 
of the stationarity of (log /it — erf) and the property log/io(0o) = logf^o- 
now show the nontrivial implication log /it (0) = log/if(0o) ^ = Oq. Re- 
placing log /it by <I>t_i(log/if_i) in the identity \oght{6) =log/it(0o) and 
accounting for ht-i{6) = (Jt^i, we obtain 

(q - ao) + (/? - /3o) loga2_i + {(7 - 7o)^t~i + (5 - ^^o)!^*-!!} = a.s. 

If /? 7^ /3o, the random variable \ogaf_i would at the same time be a mea- 
surable function of Zt~i and independent of Zt-i - This implies that \oga^_i 
is deterministic. However, taking the variance in (3.8) gives Var(log(7t_i) = 
YX=o 0^ Var (70Z0 + (5o I ^0 1 ) > since the facts that (70 , (5o) / (0, 0) and that 
the distribution of Zq is not concentrated at two points imply Var(7oZo + 
5o|.Zo|) > 0. To avoid this contradiction, necessarily P = Pq. Furthermore, if 
(a — ao,7 — 7o,(5 — 5o) / (0,0,0), there are three distinct cases concerning 
the zeros of the function f{z) = {a — oq) + (7 — 70)^ + ((^ — (Jo)^!: 

(1) / has less than or equal to two zeros. 

(2) / = 0on [0, 00) and / 7^ on (-00, 0). 

(3) //O on (0,00) and / = on (-00, 0]. 
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Using this observation and the facts that EZq = 0, KZq = 1 and that the 
distribution of Zq is not concentrated at two points, we conclude that 
f{Zt~i) = a.s. if and only if (a,/3,7) = (ao,7o,<5o)- Thus, = 6q, which 
concludes the verification of C.4. Therefore, the strong consistency of the 
QMLE in EGARCH can be established by an application of Theorem 4.1. 



Theorem 5.1. Let {{Xt,at)) be a stationary EGARCH process with 
parameters Oq = (qq, /Soj 70) '^o)'^ such that < /3o < 1 arid So > \^o\ and 
(TOi'^o) 7^ (0,0). Suppose the distribution of Zq is not concentrated at two 
points. Let K cM x [0,1) x De be a compact set with Oq £ K and such that 

E(log||Ao|k)<0, 

where Xq is given by (5.4) with m = Mg^K Ci{l - (3)'^ . Then the QMLE 
(4.2) is strongly consistent. 



5.2. AGARCH(p,g). Set = (oq, ai, . . . ,ap,/3i, . . . ,/3g,7)^ G and 
denote the true parameter vector of AGARCH(p, q) by 6q = (ag, aj, . . . , a°, 
/?[,... 7°)-^. We suppose that Oq admits a unique stationary ergodic so- 
lution {{Xt,at)) to the AGARCH(p, g) equations, which is equivalent to a 
strictly negative top Lyapunov exponent of the associated matrix sequence 
(Af) given by (3.12) with Ui = a°, f3j = I3j and 7 = 7°; see Theorem 3.5. 
Moreover, suppose a° > for some i = 1, . . . ,p because otherwise the con- 
stant sequence = ag(l — J2'j=i is the unique stationary solution of 
(3.9), which would imply that one cannot discriminate between Oq and the 
/3J's (nonidentifiability) . Another necessary restriction is (a°,/3°) / (0,0). 
Let K he a. compact subset of (0, 00) x [0, cxo)^ x B x [—1, 1] containing the 
true parameter 9q, where 



(5.5) 5 = I (/3i , . . . , /3,)^ G [0, 1)^ I J2 < 1 1 ■ 

We now verify C.1-C.4. 

In Remark 3.6 we have shown the existence of a g > with Ecg^ < 00. 
Thus, E(log"*'(TQ) < cx) is valid. 

As regards C.2, note that 

[M^)m = ( ao + a,{\Xt+i-i\ - 7Xt+i_i)A ei + C(0)s, 



1=1 



for s e C{K, [0, oo)«), where 



ei = (l,0,...,0)^GM'?, 
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see Example 3.11. Analogously to the demonstration of invertibility in 

AGARCH, A{^P) < A(CO, r G N. Note that p := supg^K{J2'j=iPj) < 1 
since K is compact. Pointwise application of the inequality (3.25) for each 
9£K yields for any s G C{K, [0, oo)'') the bound 

|(es)(6>)| < const ^'^/'?|s(6>)|, 

where the constant does not depend on s and 9. Taking the supremum on 
both sides of the latter bound, one obtains 

IICsll/^ < const Z?'^/'? II s||/f, r>0, 

showing that A(C'') < const /^'/^ as r — > oo. Therefore, conditions 1 and 
2 of Proposition 3.12 are verified. Hence, C.2 holds and ht = {ht, . . . , ht^q+i)'^ 
is properly defined. 

C.3 being obviously satisfied, we turn to the identifiability condition C.4. 
We split our arguments into a series of lemmas. First we derive an almost 
sure representation of ht, similarly to [2]. 

Lemma 5.2. The following almost sure representation for ht is valid: 

oo 

(5.6) htie) = ^oie)+Y.umxt-e\-iXt.e)^ OeK, 

with the sequence i(,ii6))i£N given by 

ao 

^oW = - 

(5.7) 



-1 



^o{e) 

oo 



be{l) 
ag{z) 



and 



^=1 beiz) ' 

where ae{z) = J2'i=i '^i^^ '^'^^ bgi^z) = 1 — Z]j=i PjZ^ ■ 

Proof. The proof rests on the observation that {ht (0)) obeys an ARMA(p, q) 
equation, that is, 



p 

1=1 



ht{e) = ao + Y,a^{\Xt-i\--fXt-.i)^ + Y,(3jht^j{e), tGZ, 
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or shorter, in backshift operator notation, 

(5.8) be{B)ht{e)=ao + ae{B){\Xt\--fXtf, t€Z. 

Since /? < 1, the zeros of the polynomial bg{z) lie outside the unit disc; 
indeed, if \z\ < (3"^/i, then \b0{z)\ > 1 - E?=i/3iNP' > 1 - = 0. 

This suggests the a.s. representation (5.6), as can be seen from a compar- 
ison with Section 3.2 of [11]. To prove this a.s. representation, we cannot, 
however, directly apply Proposition 3.1.2 in [11] because the "innovations" 
{\Xt\ — 7^t)^ may have an infinite second moment. One possible way to 
validate the a.s. representation is to show that the right-hand side of (5.6) 
is well-defined, continuous on K a.s., and that it obeys (5.8) regarded as a 
difference equation on C{K). Then, since the SRE for (h^) admits a unique 
stationary ergodic solution (hf), the right-hand side of (5.6) must coincide 
with ht- To show the three assertions mentioned before, first note that there 
are < r/ < 1 and c> with |C^(0)| < cr/^ for all £ > 1 and ^ K [apply the 
Cauchy inequalities to the complex function l/b0{z)] and, thus, in 

C(i^) as ^ ^ oo. Since is continuous on K and E[(|Xo| — 7°Xo)^^] < oo for 
a g>0 (see Remark 3.6), the series Y^'^i^i{6){\Xt-i\ —jXt-i)'^ converges 
absolutely a.s. in C{K) by virtue of Lemma 2.1. Hence, (5.6) is continuous 
a.s. Eventually it is an elementary exercise to prove that the a.s. represen- 
tation for {ht) obeys (5.8). This completes the proof of the lemma. □ 

The next lemma is concerned with the identifiability of the parameter 7. 

Lemma 5.3. Suppose that the distribution of Zq is not concentrated at 
two points. Then for any 6 G K, the relation ho{6) = ho{6o) a.s. implies 
7 = 7°- 

Proof. Note that /lo(^) = /lo(^o) a-s. is equivalent to /ifc(0) = hi^{6o) 
for any k, in particular, k = max(p, g). We rewrite hk{0) = /ifc(0o) a.s. as 

k 

(5.9) [oq- ao) +^Yk-ial_i = a.s., 

where Yk-i = a°{\Zk^i\ - 7°^fc~.)' - a^i\Zk-^\ - iZ^-if + (/3° - A). Intro- 
duce k* = min(i G [l,p] | a° > 0). Then by repeatedly expressing each term 
i = li • • • > (k* — 1), in the equation 

= + X: a°(|X,_,| - ^^X^.^f + ^ P]al^ 

i=k* j=l 

by past observations and past squared volatilities, one sees that (t| can be 
written as a function of {(|Xt_fc. \-j°Xt-.k*)'^, (|Xj„fc._i| -7°Xj_fc.„i)2, . . . ; 
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1 (y1_f^* • • •}, and consequently, erf is ^f„fc. -measurable. Relation (5.9) 
together with > > implies that is a function of (Tq, • ■ . , 
and consequently, ^fc_fc»_i-measurable. Since Ifc-i is at the same time inde- 
pendent of J^k-k*-i, it must be degenerate. With the identical arguments, 
Yk-2, ■ ■ ■ ,Yk-k* are degenerate. The degeneracy of means that 

al*{\Zk-kA - Y Zk^k*f - ak*{\Zk-.k* \ -lZk-k*f = c 
for a certain constant c. Note that a.s. on the sets {Z^-k* ^ 0} and {Zk-k* < 
0}, 

{aUl-^^f-ak*{l-if)Zl_,,=c 

and 

{al,{l + ^°f-ak*{l + lf)Zl_k,=c, 

respectively. Because the distribution of Zk-k* is not concentrated at two 
points, these two equations can only be jointly satisfied if c = 0. Since 
'KZk-k* = and EZ|_^* = 1, the distribution of Zk-k* has positive mass 
both on the negative and the positive real line, which implies q^, (1 — 7°)^ = 
afe*(l — 7)^ and a^,. (1 -|- 7°)^ = aA:*(l + 7)^- From these two equations to- 
gether with Q^, > 0, we conclude ak* > 0. Subtracting and adding the latter 
two equations yields 7 = ^"alt/ak* and 1 -|- 7^ = (1 -|- (7°)^)a^,,/afc* . Be- 
cause of the constraint I7I < 1, we can conclude 7 = 7° (and ak* = a^*), 
which completes the proof. □ 

Eventually we establish the identifiability condition C.4. 

Lemma 5.4. Suppose that the distribution of Zq is not concentrated at 
two points and that the polynomials ag^ and bg^ defined in Lemma 5.2 do 
not have any common zeros. Then for any 9 G K , 

/io(0)=ctq if and only if 6 = 6q. 

Proof. We have shown in Lemma 5.3 that hQ{6) = cjg implies 7 = 7°, 
so that in consideration of (5.6), the relation hQ{9) = Hq^Oq) becomes 

00 

UO) - UOo) + Y.(^iio) - UOoMX-il - ^°x-,f ^ 0. 

We first show ^i{6) — S^ei^o) = ^or all ^ G N by contradiction. Denote by 
i*>l the smallest integer i>l with 5e := £,i{e) - ^(,{60) / 0. Since > 
Oq > 0, we have that 

(|Z_,.|-7°Z_,.)' 

= (uOo)-UO)+ E {UOo)-Um\X-e\-l°X-eA/i5e^al,,) 
\ e=e*+i J 
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is at the same time J'-"_f*_i-measurable and independent of jr„£.„x, which is 
only possible if {\Z_£* \ — 7°Z_^*)^ is degenerate. However, from the assump- 
tion that the distribution of Zq is not concentrated at two points, it follows 
that {\Z-£* \ — 7°Z_£»)^ cannot be degenerate, that is, the desired contradic- 
tion. Using Ci{0) =Ce{Oo) in (5.7), we conclude a0{z)/h0{z) = a0^-^{z)/h0^{z). 
Write a0{z) = r{z)a0^{z) and 60(2;) = r{z)b0Q{z). The rational function r{z) 
does not have any pole because otherwise a0o(-^) ^Boi^) would have a 
common zero. Hence, r{z) is a polynomial. The degree of r is zero, because 
otherwise either 00(2) or 60(2) would have degree strictly greater than p or 
g, respectively, since (a°,/3°) / (0,0). Finally, r = 1 because the constants in 
the polynomials 6e and he^ are 1. Hence, ae = ae^ and 60 = ftgp, which gives 
6 = 9q and concludes the proof. □ 

Now an application of Theorem 4.1 yields strong consistency of the QMLE 
in AGARCH(p, q). This result generalizes Theorem 4.1 of [2]. 

Theorem 5.5. Let (Xt) be a stationary AGARCH(p, g) process with 
true parameters Oq = {aQ,al, . . . ,a°, (3i, . . . , such that we have the 

following: 

1. a° > for some i > and {a°p,P°) 7^ (0,0). 

2. The polynomials a°{z) = X]f=i (^i^^ o,''^d b°{z) = 1 — J2'j=i PjZ^ do not 
have any common zeros. 

Suppose that the distribution of Zq is not concentrated at two points and let 
K C (0,00) X [0,00)^ X B X [—1, 1] be compact and contain Oq G K, where B 
is given in (5.5). Then the QMLE (4.2) is strongly consistent. 

6. The first and second derivatives of the functions ht and ht. For estab- 
lishing the asymptotic normality of the QMLE, it is essential to understand 
the limit behavior of the sequences of functions (/iJ)tgN and (h'Dt&i and to 
study the differentiability properties of ht . The interpretation of the arising 
problems in terms of SRE's turns out to be fruitful once again. We first 
derive SRE's for the first and second derivatives of hj and in a second step 
we construct stationary approximations of (hJ)tgN and (hj')^^^; which turn 
out to coincide with (hJ)fgN and (hj')^^^, respectively. 

For a notationally tractable representation of the SRE's to be derived, we 
introduce maps 

Vt-Kx [0,oo)'i x[0,ooy, (6>,u)^(6>,(50(Xt,u),ni,...,Ug„i)), 

tez, 



P2:Kx [0,00)9^ [0,00)9, 



(0,u)h^u, 
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and set Tpt,r =P2°'Jt^ for fixed r > 1. Observe that [(^'f\s)]{0) = ■ipt,r{0,s{6)) 
for every s S C{K, [0, oo)''). In this (and only this) section, we work under the 
convention that the first- and second-order partial derivatives of a function 
f = (/i, . . . , f^)T : ;7 C ^ M"" are written as vectors, 

i' = {dli,d!i,...,d'[i,...,...,dlf,...,dZff, 

4'^f,...,9rf,...,9^'f,...,5rf)^, 

where dji := {dfj)/{dxk) and dj^^'^'^f := {d"^ fj) / (dxk-^dxk^) ■ In what follows, 
we suppose that the following regularity conditions hold: 

D.l The conditions of Proposition 3.12 are satisfied with a compact set 
K cM.'^, which is contained in the interior of the parameter space 0. 
Suppose that K coincides with the closure of its (open) interior. The 
function {0,s) ^ g0{x,s) on K x [0,oo)'' is continuously differentiable 
for every fixed x G R^. 

D.2 For all jG{l,...,g} and k e {I, . . . ,d + q} 



(6.1) E 



log+ sup 191^0,1(0, ho(0))| 

0GK 



< oo. 



Moreover, there exist a stationary sequence (Ci(t)) with E[log'^ C'i(O)] < 
oo and k £ (0,1] such that 

(6.2) sup\^!|^^^t,lie,n)-^!;^^^t^{0,u)\<Cl{t)\u-u\^, u,uG[0,oo)^ 

for every j £ {1, . . . ,q}, k £ {1, . . . ,d + q} and t £Z. 

We recall that the sequence (h()tgis} of random elements with values in 
C{K, [0,oo)i) is a solution of the SRE St+i = ^>t(sf), t G N, on C{K, [0,00)9); 
see Section 3.3. Differentiating with respect to 6 on both sides of ht+i{6) = 

MMO)) = MdMo)) yields 

(6.3) , 

i=l 

for indices j £ {1, . . . ,q},k £ {1, . . . , d}, or abridged, h^^;^ = <I>t(hj). The re- 
placement of hf by ht and by in (6.3) leads to the following (linear) 
SRE dt+i = 6t(dt) on C(K,M'^«): 

(6.4) q 

+ J2d^^'M(^MmM0)h-i)d+k, t£Z, 

i=l 
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where i = (j — \)d + k ^ {1,..., dq}. We now show the fohowing: 

(1) The SRE (6.4) has a unique stationary solution (dt), which is ergodic. 
The random element dt is .T-^-i -measurable for every t. 

(2) We have that ||hj — dtWx — ^ as t — > oo, that is, (dj)tgN is a sta- 
tionary approximation of (hJ)tgN. 

(3) The random functions are a.s. continuously differentiable on 
and for each t G Z, 

Since we establish relation (1) via Theorem 2.8, we need to show that is 
a contraction on average for r large enough. As is obvious from elementary 
calculus, 

(6.5) q 

+ Vt,r (0, hi„,+i (0) ) [d(0)] . 

i=l 

From ipt,r{(^,'Vi) =P2° V^t'^H^ju) = we deduce that 

|V't,,(0,u)-Vt,r(0,u)| <A(^>f))|u-u|, U,liG [CCX))"?, 

and therefore, 

(6.6) sup|9,^+Vi,r(0,ht_,+i(0))|<A(«>f^ tGZ, 
e<^K 

for alH G {1, . . . , q}. Using the representation (6.5) and applying inequality 
(6.6), we obtain 

|[6f)(d)(0)],-[ci>M(d)(0)],| 

< A(cl>f-))^ |[d(0)](,_i),+, - [d(0)](,_i),+,| 

1=1 

< const xA($f ^)||d - d||K, d,d G C(J^,M'^«), 
for all £ G {1, ... , dq} and 6 £ K, whence 

A(6f)) <cA(^f')) 

(r) 

for a certain constant c > not depending on r. Since E[log A($q )] — > — oo 
as r — > oo, we can choose r so large that 

E[logA($[,'^^)] < logc + E[logA($J''^)] < 0. 
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Thus, the SRE d^+i = <I>t(dt), t £ Z, obeys condition S.2 of Theorem 2.8, 
and S.l is true by virtue of (6.1). Consequently, the latter SRE admits a 
unique stationary ergodic solution (d^), for which dt is .T-^-i -measurable for 
every t. As regards the limit relation (2), we need to study the perturbed 
SRE 

qt+l = 6t(qt), tEN, 

which has (hJ)jgN as one of its solutions. By the assumption (6.2), the trian- 
gle inequality. Proposition 3.12 and an application of Lemma 2.1, we have 
that 

\\^t{0) - MO)\\k < const xCi{t)\\ht - htW^K 0, t ^ oo, 

and 

Mk - ^t) < const xC'i(t)||ht - htll^ "-^ 0, t ^ oo. 

Now an application of Theorem 2.10 demonstrates ||hj — dt\\K as 
oo. It remains to prove relation (3). Since K coincides with the closure 
of its interior, the continuous differentiability of on K can be established 
by showing the existence of a sequence (f„)„gN of continuously differentiable 
functions on K such that ^ in C(K,M5) and ^ dt in C{K,R'^i) 
as n ^ oo; see Theorem 5.9.12 in [21]. For every fixed m > 0, the sequence 
((hj^,dt)) is stationary ergodic by virtue of Proposition 2.5 [see (3.29) for 

the definition of h^^m]. Since = h^, another application of Proposi- 

tion 2.5 implies — dj = — d^, m>0. On the other hand, we have al- 

ii'^/ iicas P 

ready shown that ||h^ — dm||x — — >' 0. Thus, ||h( ^ — df ||i^ — > as m — > oo, 
and therefore, there is a subsequence hj with ||h^m„ ~ ^t\\K as 
n ^ oo. If we set f„ = hj^^n, n G N, then the sequence (f„)„gN satisfies 
f„ ^ ht in CiK,^) and ^ dt in C{K,R'^i) as n ^ oo. This completes 
the proof of assertion (3). Summarizing, we have obtained the following 
proposition. 

Proposition 6.1. Assume that conditions D.l and D.2 are satisfied. 
Then the SRE df+i = <&t(dt) defined by (6.4) has a unique stationary so- 
lution (dt), which is ergodic. For every t £ Z, the random element dt is 
Tt-i-'^^o-surahle. For every t £Z, the first derivatives o/hj coincide with St 
on K a.s. Moreover, 

\\h't-dt\\K^-^0, t^oo. 
This justifies the following definition for the first derivatives of : = d^ . 
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Similar results can be derived for (hf')(gN- At the origin of the analysis 
we have the observation that (h^')fgN obeys an SRE, which is contractive 
provided certain regularity assumptions hold. One can more or less follow 
the lines of proof of Proposition 6.1. In addition to D.l and D.2, we will also 
assume the following set of conditions. 

D.3 The function {6, s) gg^x, s) on K x [0, oo)"? is twice continuously dif- 
ferentiable for every fixed x G W. For all j € {l,...,q} and ki,k2 G 
{l,...,d + q}, 



(6.7) E 



log+( sup|5}^^''^>o,i(^,ho(0))| 



< oo. 



(6.^ 



The sequence of first derivatives (h^) satisfies E(log^ ||hQ||j^) < oo. More- 
over, there exist a stationary sequence {C2{t)) with E[log''~ (^2(0)] < 00 
and k£ (0,1] such that 

sup \d''^''i;t,i{e,n) - d'''''Me,n)\ 
oeK 

< C'2(t)|u- al^, u,iiG[0,oo)^ 
for every j £ {1,. . . ,q}, ki,k2 £ {I, ■ ■ ■ ,d + q} and t G Z. 

Proposition 6.2. Assume that conditions D.1-D.3 are satisfied. Then 

w-Llf II e.a.s. „ 

where (e^) is characterized as the unique stationary ergodic solution of the 
(linear) SRE (6.9) below. For every t gTj, the random element ej is J-t~i- 
measurable. The second derivatives of hj on K coincide with a.s. for 
every t. Therefore, the following definition for the second derivatives of ht 
is justified: h'/ = et . 

Proof. Differentiation of both sides of (6.3) with respect to 9 shows 

that h"^^ = 4>t(hj'), where is a linear random map. More precisely, for 
every j £{l,...,q} and ki,k2 G {l,...,d}, 

9|i'*^^hi+i(0) = 5^^''=>t,i(0,hi(0)) + ^9f''^+Vi,i(0,ht(0))af^hi(0) 

i=l 

Q 



+ E 9f *'''+Vt,i(0,ht(0))5,^ht(0)) 9^ht(0) 
i'=l ) 

+ j2df^'^tA^M0))df'^'''ht{9), ten. 



i=l 
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This suggests to consider the (hnear) SRE on C{K,Mf^^'^), 
(6.9) et+i = ^t{et), t£Z, 

where for i = {j - 1) (P + {ki - 1) d + k2 G {I, . . . , d^q}, 

1=1 

+ E 9f ''''+Vi,i(^,hi(0))9^^hi(0) ) dl'MO) 
i'=i J 

i=l 

eGC(i^,M'^''?). 

Exploiting the conditions (6.7) and E(log"'' ||hQ||i^) < cxd in D.3, one shows 
with exactly the same arguments as in the proof of Proposition 6.1 that the 
SRE (6.9) obeys the conditions of Theorem 2.8, which implies that it has a 
unique stationary ergodic solution (ej). Furthermore, is J^t_i-measurable 
for every t. By means of the decomposition 

abc — abc = {a — a)bc + {a — a){b — b)c + {a — a) {b — b){c — c) 

+ (a — a)b{c — c) + a{b — b)c + a{b — b){c — c) + ab{c — c) 

and application of the bounds (6.8) together with ||hj — hj||^ and 
||hj — h[\\f^ ^—^ 0, it can be verified that (<E>t) and {^t)t£N satisfy the condi- 
tions of Theorem 2.10. Thus, ||hj' — et\\K — 0. Analogously to the proof of 
Proposition 6.1, one demonstrates = hj'. This concludes the proof. □ 

7. Asymptotic normality of the QMLE. As we indicated in the Introduction, 
it is convenient to first establish the asymptotic normality of 0„, defined 
in (4.4), and second to establish the asymptotic equivalence of On and On, 
that is, y/n{6n — On) — — * 0. Following the classical approach, we will es- 
tablish the asymptotic normality of On by means of a Taylor expansion of 
L'n = (EtLi^t)') where it = -'^'^ (^og h + / ht) . For this reason, it is es- 
sential to study the limit properties of and L'^. Now we formulate the 
basic assumptions used throughout this section: 

N.l The assumptions C.1-C.4 of Section 4 are satisfied fulfilled and the true 
parameter Oq lies in the interior of the compact set K. 
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N.2 The assumptions D.1-D.3 of Proposition 6.2 are met so that ht is twice 

continuously differentiable on K. 
N.3 The following moment conditions hold: 

(i) EZ^<oo, 

(iii) Ell^fjlli^ <oo, 

(iv) E\\Q\k < oo. 

N.4 The components of the vector ^-(Xq, o-q)!^^^^ are linearly independent 
random variables. 

By virtue of Theorem 4.1, condition N.l implies consistency. The require- 
ment that 9q is in the interior of K and N.2 enable the differentiation of L„ 
in an open neighborhood of 6q. Assumption N.4 assures that the asymptotic 
covariance matrix is regular. Observe that, with probability one. 



2ht{9)y ht{e), 

(7.2) eiio) = -l-l-^^(^{h[{e)fh[{e) (^2^ - 1) + h'l{e){ht{e) - x^)) . 

From Propositions 3.1, 3.12, 6.1 and 6.2, we infer that and are 
stationary ergodic sequences of random elements with values in C{K,W^) 
and C(i^, M'^'^'^), respectively. An inspection of the proof of Theorem 4.1 
shows that condition N.l also implies On — — > ^o- Consequently, for large 
enough n, the following Taylor expansion is valid: 

(7.3) L'M = L'M + KiUiOn - eo), 

where — 0o| < l^n — ^o|- Since On is the maximizer of L„ and Oq lies in 
the interior of K, one has L'n{On) =0. Therefore, (7.3) is equivalent to 

(7.4) n~^Ll{Cn){On - Oo) = -n-'L'n{Oo). 

On account of E||£q||x < oo and the stationarity and ergodicity of {if), we 
may apply Theorem 2.7 to obtain L'^/n L" in C{K,R'^'"^) as n ^ oo, 
where L"{0) =E[£q(0)], € K. This uniform convergence result together 
with C,n ~* ^0 implies 



in(C„)/n^E[£[;(0o)]=Bo, n^oo. 

By Propositions 3.12, 6.1 and 6.2, /iq, h'^ and /iq are jr_i-measurable. Ex- 
ploiting hQ{OQ) = (7q a.s., Xq = uqZq and the independence of Zq and T-i, 
one may conclude that 

(7.5) Bo = -2-'E[{h'oiOo)fh'o{Oo)/a^]. 
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It is shown in Lemma 7.2 below that Bq is invertible. Consequently, the 
matrix L'^(^„)/n has inverse Bq'^(1 +op(l)), oo, and (7.4) has 

^/^(0„ - 9o) = -Bo 1(1 + op(1))L;(0o)/V^, n ^ oo, 

as a consequence. Therefore, the limit of ^/n{Qn — ^o) is determined by that 
of — Bq iL^(0o)/\Ai- Since htiOo) = erf a.s. and Xt = atZt, 

t=l ^ i=l 

Since the random element h't/af is -measurable and since J-t~i is in- 
dependent of Zt and EZj^ = 1, the sequence (£j(0o))ieN is a stationary er- 
godic zero-mean martingale difference sequence with respect to the filtration 
{J^t)t<m- By virtue of the moment condition N.3, the sequence (£j(0o))tGN 
is furthermore square integrable. Consequently, we can apply the central 
limit theorem for square-integrable stationary ergodic martingale differ- 
ence sequences; see Theorem 18.3 in [3], which says that n-i/2L;(0o) ^ 
AA(O,E[(£[)(0o))'^^o(^o)]), n^oo. Together with (7.5), we conclude 

V^(0„-6>o)^AA(O,Vo), n — > oo, 

where 

(7.6) \, = A-'nz',-i)mK{Oo)YK{e,)/at\r\ 

It is shown in Lemma 7.4 below that ^/n\On — On\ — — > so that an application 
of Slutsky's lemma finalizes the proof of the following theorem. 

Theorem 7.1. Under the conditions N.1-N.4, the QMLE On is strongly 
consistent and asymptotically normal, that is, 

V^(0„-6>o)^AA(O,Vo), n^oo, 
where the asymptotic covariance matrix Vq is given by (7.6). 

First we show that the asymptotic covariance matrix is regular. 

Lemma 7.2. The assumptions N.1-N.4 imply that Bq = E[-fo(0o)] is neg- 
ative definite. 

Proof. Bq being negative definite is equivalent to Cq = E[(ho(0o))'^^o(^o)/ 
(Tq] being positive definite. It is evident that Cq is positive semi-definite. As- 
sume Xq^CoXq = 0, for some xq G M'^. This is equivalent to 



E 



0, 
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which imphes /io(0o)xo = a.s., and also hQ(0o)xo = due to the stationar- 
ity of (hj). Multiplying the equation 



0=6*0 



0=00 ds 

from the right by xq and accounting for /i']^(0o)xo = results in (9(70 (Xq, Cq)/ 
d6)\0=Q^^XQ = a.s. Condition N.4 implies xq = 0. This concludes the proof. 

□ 

The remaining steps are devoted to the proof of Lemma 7.4. 

Lemma 7.3. The assumptions N.1-N.2 imply 

n ' \\Lj^ — Lj^Wk — >0, n ^ oo. 

Proof. Notice that C.3 implies ht{6), ht{e) > g> for all OgK. This 
and the mean value theorem applied to the function f{a,b) = ab"^{l — 
X^/b), aeR,b>g, yield 



^t-K\\K 



hf^r xl\ h^f^ X} 

hX ht) ht 



K 



(7-7) 

< c(i + x^){\\ht - htU + \\K - KWk + \\K - KWIWKWk} 

for some C > 0. Recall that we assume E(log"*' Cq) < oo, E(log''~ ||/io||a-) < oo, 
and observe that Propositions 3.12 and 6.1 imply \\ht — ht\\K — and \\h[ — 
^[Wk -—^ as i — > oo. Now (7.7) together with an application of Lemmas 
2.1 and 2.2 shows - L'J\k < Et^i ¥'t - ^'iWk < oo a.s. This completes 
the proof. □ 

Lemma 7.4. The assumptions N.1-N.4 imply 

y/n\On - On\ ^ 0, n ^ OO. 

Proof. From the mean value theorem, 

(7.8) L'n{6n) - L'n{On) = L^(C„,)(^n. - On), 

where li^s on the line segment connecting 0,„ and On- This line segment is 
completely contained in the interior of K provided n is large enough. Since 
L'^{On) = L'^{On) = 0, equation (7.8) is equivalent to 

(7.9) n-'/\L'M - L'n{On)) = n'^ Ll{CnW/\On - On). 

By virtue of Lemma 7.3, both sides of (7.9) tend to a.s. as n — > oo. Because 
of N.3(iv), we can apply Theorem 2.7 to L'^/n and together with ^„ Oq 
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conclude L^(^„)/n Bq = E[£q(0o)]- Since the matrix Bq is invertible, as 
shown by Lemma 7.2, we can deduce ■y/n(0„, — On) — — > 0, which completes 
the proof. □ 

Remark 7.5. In general, it seems impossible to find a tractable expres- 
sion for the asymptotic covariance matrix Vq due to the fact that the joint 
distribution of (cq, /iq(0o)) is not known, not even for GARCH(1,1). It is, 
however, possible to consistently estimate Vq from the data. Defining the 
residual by ^ = Xt/{ht{en))^/\ 




is a strongly consistent estimator for the matrix Vq. We sketch how this can 
be demonstrated. Define 

(/,,(0))2 

and suppose E II /iQ/holl|c < oo in addition to N.1-N.4. Then by an application 
of Theorem 2.7, M„ ^ M in C(K,M'^^'^), where M(0) = E[(/i^(0))^/i'o(0)/ 
(/io(0))^]. Using the same method as in Lemma 7.3, one derives a bound 
for ||Mn — M.„||ft- and shows ||Mn — M„||i^ 0, which implies M„ M 
in C(K,M'^^'^) as n^oo. Therefore, (M„(0„))-^ ^ (M(0o))~^- Likewise, 
n~^Ylt=i{{^t^^)'^ — 1) can be shown to converge to E(Zq — 1) a.s. We also 
mention that the practical implementation for the computation of the matrix 
Vq"^ becomes pari 
see equation (6.3). 



Vq"^ becomes particularly simple if one makes use of the recursion for h^; 



8. Examples: asymptotic normality of QMLE in AGARCH(p, q). At 

the moment we cannot provide a proof of the asymptotic normality of the 
QMLE in the general EGARCH model, because it is intricate to verify the 
moment conditions in N.3. However, one can deal with the special case when 
/3o = 0; see [31]. In this paper we concentrate on establishing the asymptotic 
normality of the QMLE in AG ARCH (p, q) and thereby generalize the results 
of [2]. 

Take a compact set K C (0,co) x [0,cx))^ x B x [—1,1] which coincides 
with the closure of its interior. Assume that the true parameter vector 
^0 = (oq, 0°, aS, /?!,..., /3°, 7°)"^ is contained in the interior of K and 
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suppose the conditions of Theorem 5.5 hold. Analogously to [2], we assume 
EZq < oo and suppose there is a /U > such that 



|Zo|<z) = o(z^), 



The verification of conditions D.1-D.3 of Section 6 is rather straightforward. 
The only steps which require some care are the moment conditions. The 
arguments in Remark 3.6 imply that there is a q > with E|(ToP^ < oo, 
and hence, also E|Xop'' < oo. The Minkowski inequality applied to the left- 
hand side of (5.6) shows that EH/iolll- < oo. Altogether, E(log~*" erg) < 
and E(log"*' H/iolli^) < oo. By standard methods, one can also show that the 
differential and the series in (5.6) can be interchanged. Then E(||/iq|||^) < oo 
and E(log^ ll^oll/s:) < follow. Altogether we have established N.l and N.2. 
It is less easy to prove the moment conditions of N.3. At the origin lies the 
observation that the random variables ||/io/^o||i<r ^.nd ||/iQ//io||_ft: have finite 
moments of any order and that 

^ < oo 

for any u <2; this follows from the same ideas and techniques as used to 
prove Lemmas 5.1 and 5.2 in [2]. Therefore, by an application of the Holder 
inequality to the norm of (7.1), Epoll-R" < °o. As to the second derivative 
Iq, we mention that the inequality 



I Til 

\xy \\k 



for any two elements x,y £ C{K,] 
applied to (7.2) implies 



< IkllA-llylk 

together with the triangle inequality 



< 



1 



K 

ho 



K 



+ 1 + 



K 



h" 



K 



1 + 



h 



K 



By an application of the Holder inequality, Epg||i^ < oo. Thus, conditions 
N.1-N.3 of Section 7 are satisfied. N.4 will be verified in Lemma 8.2 below. 
Now an application of Theorem 7.1 yields the following result. 



Theorem 8.1. Let (Xt) be a stationary AGARCH(p, g) process with 
true parameter vector Oq = (ag, aj, . . . , a°, . . . , /3°,7°)'^ in the interior of 
the compact set K C (0, oo) x [0, oo)^ x i? x [—1,1], where B = {{fii, . . . ,Pq)'^ G 
[0,1)'' I J2'j=iPj < Suppose also that K coincides with the closure of its 
interior. Assume that the conditions of Theorem 5.5 hold and that Zq sat- 
isfies KZq < oo and (8.1). Then the QMLE (4.2) is strongly consistent and 
asymptotically normal with asymptotic covariance matrix \q given by (7.6). 

Lemma 8.2. Under the conditions imposed by Theorem 8.1, the condi- 
tion N.4 is satisfied. 
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Proof. By straightforward computation, 



0=00 

2 {\ v"2 I ^2 ^2 ^2 



= (l>(l^o| -7°^o) ,•■ -,(1^-^+1 1 -7°-^-p+i) ,O-0'---'Cr_5+i, 

- 2a?Xo(|Xo| - 7°^o) 2a;X„p+i(|X_p+i| - 7°X_p+i))^. 

Assume for a ^ = (Aq, . . . , Ap, /ii, . . . , /Xg, Vj)^ G R?'+''+2 that 

(8.2) ^(^».-o)L..,« = »- 

Writing out the latter equation results in 
Ao + cTg(Ai(|Zo| - 7°^o)' + /ii - 2r7a?Zo(|Zo| - 7°^o)) + = a.s, 

where YLi is a certain -measurable random variable. Consequently, the 
multiplier of ctq in the latter identity must be degenerate, that is, 

(8.3) (Ai(l + (7°)') + 2r/a?7°)z2-(27°Ai + 2r7a?)Zo|Zo|+;Ui = c a.s. 

for a certain c G M. Since the distribution of Zq is not concentrated at two 
points, {1, Zo\Zo\, Zq} are linearly independent. Combining this information 
with (8.3) and taking into account that > and |7°| < 1, we conclude 
Ai = = /ii — c = 0. Thus, we must show the linear independence of 1, (l^ol — 
7°Xo)2,...,(|X2p_^J - 7°X_p+i)2,(Tg,...,o-2^_^^. The following arguments 
are similar to the ones used by Berkes, Horvath and Kokoszka [2] for the 
proof of their Lemma 5.7. Equation (8.2) with r] = and the stationarity of 
{{Xt,at)) imply 

p q 

i=i j=i 
which equivalently written in backshift operator notation becomes 

(8.4) Xo + X{B){\Xt\--f°Xtf + fiiB)a^ = a.s., 
with 

p g 
X{z) = E Xiz"^ and fi{z) = E fJ'jZ'^ ■ 
i=i j=i 

Recall Lemma 5.2, where we derived the a.s. representation 

(8.5) = ^ + ^''iBW{B)r\\Xt\ - YXtf 
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with a°{z) = J2f=i Oi°z^ and b°{z) = l-J2'j=iPjZ^ ■ Plugging (8.5) into (8.4), 
we obtain that 

Ao + + (A(S) + KB)a%BWm-')i\Xt\ - ^Xtf = a.s., 

and with the identical arguments as given in Lemma 5.4, we conclude 

If /i 7^ 0, the rational function ^{z)a°{z) /h°[z) has at least p+1 zeros 
(counted with their multiplicities), whereas \{z) has at most p zeros, which 
is a contradiction. Therefore, /i(z) = \{z) = and ^ = 0, which completes 
the proof. □ 

9. Nonstationarities. So far our considerations were based on the funda- 
mental assumption that we sample from the unique stationary solution to 
the SRE (3.1) of the general heteroscedastic model. This is a strong assump- 
tion, particularly in light of Remark 3.2. There we mentioned that simulating 
the stationary solution is, in general, impossible, and we provided an algo- 
rithm which generates a sequence (fccr^)^^^ which approaches the stationary 
solution (fccr^igf^ of (3.2) with an error decaying to zero exponentially fast 
as t ^ oo: 

(1) Take an initial value ^ [Oi^o)'^, set fcci-Q = <Jq, and generate 
according to (3.2). 

(2) Set {dlXt) = {k^l^Y'^{l,Zt), t = 0,l,.... 

Notice that <fo G [0, oo)'^ is an arbitrarily chosen initial value. Correspond- 
ingly, we define Xt = dtZt and observe that \X^ — Xf\ = Zf\af — Uj | '^-—^ 
as t ^ oo by virtue of Proposition 3.1 and Lemma 2.1. To the best of 
our knowledge, simulation studies have been based on random samples of 
{Xt,t = —p+1, . . . ,n), rather than of {Xt,t = —p+1, . . .n); see, for example, 
[23]. The effects of this inherent nonstationarity due to some initialization 
error are hardly ever addressed. Although simulation studies are most often 
carried out for determining the small sample behavior of estimators, from 
a theoretical point of view, a minimal requirement to validate the simula- 
tion approach would be the asymptotic equivalence of the QMLE applied to 
{Xt)t>-p+i and to {Xt)t>-p+i- Let Ln = Y.t=iiXt /^t + ^oght) denote the 
likelihood based on the observations {Xt,t = —p + 1, . . . ,n). To establish the 
asymptotic equivalence of 6^ and of the maximizer of we merely need 
to show n~^\\Ln — LnWx — and n~^/^||L^ — 0. One can impose 

conditions on the functions ge-, which imply the latter two relations, but 
since everything is in line with the ideas already presented in this paper, we 
omit the details. 
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